Jun 06 00:55:37 devstack cinder-volume[75886]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75886) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 06 00:55:37 devstack cinder-volume[75886]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75886) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 06 00:55:37 devstack cinder-volume[75886]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75886) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 06 00:55:38 devstack cinder-volume[75886]: INFO dbcounter [None req-230b16de-8245-494e-bd94-660435466417 None None] Registered counter for database cinder
Jun 06 00:55:38 devstack cinder-volume[75886]: DEBUG oslo_db.sqlalchemy.engines [None req-230b16de-8245-494e-bd94-660435466417 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75886) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 06 00:55:38 devstack cinder-volume[75886]: DEBUG dbcounter [-] [75886] Writer thread running {{(pid=75886) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 06 00:55:38 devstack cinder-volume[75886]: INFO cinder.rpc [None req-230b16de-8245-494e-bd94-660435466417 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 06 00:55:38 devstack cinder-volume[75886]: INFO cinder.rpc [None req-230b16de-8245-494e-bd94-660435466417 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 06 00:55:38 devstack cinder-volume[75886]: DEBUG oslo_db.sqlalchemy.engines [None req-230b16de-8245-494e-bd94-660435466417 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75886) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 06 00:55:38 devstack cinder-volume[75886]: INFO cinder.volume.manager [None req-230b16de-8245-494e-bd94-660435466417 None None] Determined volume DB was empty at startup.
Jun 06 00:55:38 devstack cinder-volume[75886]: DEBUG cinder.volume.manager [None req-230b16de-8245-494e-bd94-660435466417 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75886) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Jun 06 00:55:38 devstack cinder-volume[75886]: INFO cinder.volume.manager [None req-230b16de-8245-494e-bd94-660435466417 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 06 00:55:38 devstack cinder-volume[75886]: WARNING stevedore.named [None req-230b16de-8245-494e-bd94-660435466417 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 06 00:55:38 devstack cinder-volume[75886]: WARNING castellan.key_manager [None req-230b16de-8245-494e-bd94-660435466417 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 06 00:55:38 devstack cinder-volume[75886]: WARNING cinder.keymgr.conf_key_mgr [None req-230b16de-8245-494e-bd94-660435466417 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 06 00:55:38 devstack cinder-volume[75886]: DEBUG cinder.volume.drivers.lvm [None req-230b16de-8245-494e-bd94-660435466417 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75886) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jun 06 00:55:38 devstack cinder-volume[75886]: DEBUG oslo_concurrency.processutils [None req-230b16de-8245-494e-bd94-660435466417 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75886) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_concurrency.processutils [None req-230b16de-8245-494e-bd94-660435466417 None None] CMD "cinder-rtstool verify" returned: 0 in 0.357s {{(pid=75886) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_db.sqlalchemy.engines [None req-230b16de-8245-494e-bd94-660435466417 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75886) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 06 00:55:39 devstack cinder-volume[75886]: INFO cinder.rpc [None req-230b16de-8245-494e-bd94-660435466417 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jun 06 00:55:39 devstack cinder-volume[75886]: INFO cinder.rpc [None req-230b16de-8245-494e-bd94-660435466417 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jun 06 00:55:39 devstack cinder-volume[75886]: WARNING stevedore.named [None req-230b16de-8245-494e-bd94-660435466417 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 06 00:55:39 devstack cinder-volume[75886]: WARNING castellan.key_manager [None req-230b16de-8245-494e-bd94-660435466417 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 06 00:55:39 devstack cinder-volume[75886]: INFO cinder.volume.manager [None req-230b16de-8245-494e-bd94-660435466417 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_db.sqlalchemy.engines [None req-230b16de-8245-494e-bd94-660435466417 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75886) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 06 00:55:39 devstack cinder-volume[75886]: INFO oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] Starting 1 workers
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] Started child 76051 {{(pid=75886) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] Full set of CONF: {{(pid=75886) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] ******************************************************************************** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] Configuration options gathered from: {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] ================================================================================ {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] allow_availability_zone_fallback = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] allow_compression_on_image_upload = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] allowed_direct_url_schemes     = [] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] api_rate_limit                 = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] auth_strategy                  = keystone {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] az_cache_duration              = 3600 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_availability_zone      = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_host                   = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_name                   = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_stats_polling_interval = 60 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backup_api_class               = cinder.backup.api.API {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backup_name_template           = backup-%s {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backup_use_same_host           = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[76051]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0)
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backup_use_temp_snapshot       = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] chap_password                  = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] chap_username                  =  {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cinder_internal_tenant_project_id = d3264f1d847f47068098ab5d399b216e {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cinder_internal_tenant_user_id = f5b2a8ad4db141ecba607206934a4a15 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cloned_volume_same_az          = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cluster                        = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] compression_format             = gzip {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] config_dir                     = [] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] config_source                  = [] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] control_exchange               = openstack {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] debug                          = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] default_availability_zone      = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] default_group_type             = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] default_volume_type            = lvmdriver-1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] disk_geometry                  = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] driver_client_cert             = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] driver_client_cert_key         = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] driver_data_namespace          = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] driver_ssl_cert_path           = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] driver_ssl_cert_verify         = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] driver_use_ssl                 = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] enable_force_upload            = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] enable_new_services            = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] enable_unsupported_driver      = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] enforce_multipath_for_image_xfer = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] filter_function                = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance_api_insecure            = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance_api_servers             = ['http://192.168.122.246/image'] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance_api_ssl_compression     = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance_ca_certificates_file    = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance_certfile                = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance_keyfile                 = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance_num_retries             = 3 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance_request_timeout         = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] goodness_function              = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] graceful_shutdown_timeout      = 5 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] group_api_class                = cinder.group.api.API {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] host                           = devstack {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] image_compress_on_upload       = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] image_conversion_address_space_limit = 1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] image_conversion_cpu_limit     = 60 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] image_conversion_disable       = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] image_upload_use_cinder_backend = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] image_upload_use_internal_tenant = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] image_volume_cache_enabled     = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] image_volume_cache_max_count   = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] image_volume_cache_max_size_gb = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] init_host_max_objects_retrieval = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] iscsi_target_flags             =  {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] iscsi_write_cache              = on {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] iser_helper                    = tgtadm {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] iser_ip_address                = 192.168.122.246 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] iser_port                      = 3260 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] log_color                      = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] log_config_append              = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] log_dir                        = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] log_file                       = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] log_options                    = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] log_rotate_interval            = 1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] log_rotate_interval_type       = days {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] log_rotation_type              = none {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] max_age                        = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] max_logfile_count              = 30 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] max_logfile_size_mb            = 200 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] max_over_subscription_ratio    = 20.0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] message_reap_interval          = 86400 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] message_ttl                    = 2592000 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] migration_create_volume_timeout_secs = 300 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] monkey_patch                   = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] monkey_patch_modules           = [] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] my_ip                          = 192.168.122.246 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] no_snapshot_gb_quota           = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] num_iser_scan_tries            = 3 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] num_shell_tries                = 3 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] num_volume_device_scan_tries   = 3 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] nvmeof_conn_info_version       = 1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] nvmet_ns_id                    = 10 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] nvmet_port_id                  = 1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] osapi_max_limit                = 1000 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] osapi_volume_ext_list          = [] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] osapi_volume_listen_port       = 8776 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] osapi_volume_use_ssl           = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] osapi_volume_workers           = 2 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] per_volume_size_limit          = -1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] periodic_fuzzy_delay           = 60 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] periodic_interval              = 60 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] public_endpoint                = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] publish_errors                 = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] quota_backup_gigabytes         = 1000 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] quota_backups                  = 10 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] quota_gigabytes                = 1000 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] quota_groups                   = 10 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack sudo[76056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] quota_snapshots                = 10 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] quota_volumes                  = 10 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] rate_limit_burst               = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] rate_limit_except_level        = CRITICAL {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] rate_limit_interval            = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] reinit_driver_count            = 3 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] replication_device             = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack sudo[76056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] report_discard_supported       = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] report_interval                = 120 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] reservation_clean_interval     = 86400 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] reservation_expire             = 86400 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] reserved_image_namespaces      = [] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] reserved_percentage            = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] rpc_response_timeout           = 120 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] run_external_periodic_tasks    = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] scst_target_driver             = iscsi {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] scst_target_iqn_name           = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] service_down_time              = 720 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] shell_completion               = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] snapshot_name_template         = snapshot-%s {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] snapshot_same_host             = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] split_loggers                  = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] state_path                     = /opt/stack/data/cinder {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] storage_availability_zone      = nova {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] storage_protocol               = iSCSI {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] syslog_log_facility            = LOG_USER {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] target_helper                  = lioadm {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] target_ip_address              = 192.168.122.246 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] target_port                    = 3260 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] target_protocol                = iscsi {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] target_secondary_ip_addresses  = [] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] trace_flags                    = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] transport_url                  = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] until_refresh                  = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] use_chap_auth                  = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] use_default_quota_class        = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] use_journal                    = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[76051]: INFO cinder.volume.manager [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] use_json                       = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] use_multipath_for_image_xfer   = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] use_stderr                     = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] use_syslog                     = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] verify_glance_signatures       = enabled {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] volume_api_class               = cinder.volume.api.API {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] volume_backend_name            = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] volume_clear                   = zero {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] volume_clear_ionice            = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] volume_clear_size              = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] volume_copy_bps_limit          = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] volume_dd_blocksize            = 1M {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] volume_name_template           = volume-%s {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] volume_service_inithost_offload = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] volume_usage_audit_period      = month {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] zoning_mode                    = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_concurrency.disable_process_locking = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.admin_password = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.admin_token = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.admin_user  = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.auth_port   = 35357 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.auth_protocol = https {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.auth_section = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.auth_type   = password {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.auth_uri    = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.auth_version = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.cache       = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.certfile    = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.identity_uri = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.include_service_catalog = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.insecure    = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.interface   = public {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.keyfile     = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.memcache_password =  {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.memcache_username =  {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.region_name = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.service_type = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.246/identity {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.backend                  = dogpile.cache.null {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.055s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.backend_argument         = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.backend_expiration_time  = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.config_prefix            = cache.oslo {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.debug_cache_backend      = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.enable_retry_client      = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.enable_socket_keepalive  = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.enabled                  = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.enforce_fips_mode        = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.expiration_time          = 600 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.hashclient_retry_attempts = 2 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.memcache_dead_retry      = 300 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.memcache_sasl_enabled    = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.password                 = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.proxies                  = [] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.redis_db                 = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.redis_server             = localhost:6379 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.retry_attempts           = 2 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.retry_delay              = 0.0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.socket_keepalive_count   = 1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.socket_keepalive_idle    = 1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.socket_keepalive_interval = 1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.socket_timeout           = 1.0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.tls_allowed_ciphers      = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.tls_cafile               = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.tls_certfile             = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.tls_enabled              = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.tls_keyfile              = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cache.username                 = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] coordination.backend_url       = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.asyncio_connection    = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.asyncio_slave_connection = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.backend               = sqlalchemy {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.connection            = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.connection_debug      = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.connection_parameters =  {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.connection_recycle_time = 3600 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.connection_trace      = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.db_inc_retry_interval = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.db_max_retries        = 20 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.db_max_retry_interval = 10 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.db_retry_interval     = 1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.max_overflow          = 50 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.max_pool_size         = 5 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.max_retries           = 10 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.mysql_wsrep_sync_wait = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.pool_timeout          = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.retry_interval        = 10 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.slave_connection      = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:39 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.sqlite_synchronous    = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.synchronous_reader    = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] database.use_db_reconnect      = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] profiler.connection_string     = messaging:// {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] profiler.enabled               = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] profiler.es_doc_type           = notification {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] profiler.es_scroll_size        = 10000 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] profiler.es_scroll_time        = 2m {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] profiler.filter_error_trace    = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] profiler.hmac_keys             = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] profiler.sentinel_service_name = mymaster {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] profiler.socket_timeout        = 0.1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] profiler.trace_requests        = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] profiler.trace_sqlalchemy      = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] profiler_jaeger.process_tags   = {} {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] profiler_jaeger.service_name_prefix = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] profiler_otlp.service_name_prefix = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_policy.enforce_new_defaults = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: WARNING oslo_config.cfg [None req-230b16de-8245-494e-bd94-660435466417 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_policy.enforce_scope      = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_policy.policy_default_rule = default {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:40 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] privsep_osbrick.group          = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] privsep_osbrick.helper_command = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] privsep_osbrick.user           = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cinder_sys_admin.group         = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cinder_sys_admin.helper_command = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] cinder_sys_admin.user          = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] service_user.auth_section      = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] service_user.auth_type         = password {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] service_user.cafile            = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] service_user.certfile          = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] service_user.collect_timing    = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] service_user.insecure          = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] service_user.keyfile           = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] service_user.send_service_user_token = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] service_user.split_loggers     = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] service_user.timeout           = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance.auth_section            = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance.auth_type               = password {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance.certfile                = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance.collect_timing          = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance.insecure                = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance.keyfile                 = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance.region_name             = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance.split_loggers           = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] glance.timeout                 = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.backend_availability_zone = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.chap_password = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.chap_username =  {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.disk_geometry = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.driver_client_cert = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.driver_client_cert_key = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.driver_data_namespace = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.driver_use_ssl = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.extra_capabilities = {} {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.filter_function = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.goodness_function = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.iscsi_target_flags =  {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.iscsi_write_cache = on {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.iser_ip_address = 192.168.122.246 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.iser_port     = 3260 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.lvm_share_target = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.lvm_type      = auto {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.num_shell_tries = 3 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.replication_device = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.report_discard_supported = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.reserved_percentage = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.target_helper = tgtadm {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.target_ip_address = 192.168.122.246 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.target_port   = 3260 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.target_protocol = iscsi {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.trace_flags   = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.unique_fqdn_network = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.use_chap_auth = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.volume_backend_name = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.volume_clear  = zero {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.volume_clear_ionice = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.volume_clear_size = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_reports.file_event_handler = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_reports.log_dir           = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.backend_host       = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.chap_password      = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.chap_username      = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.disk_geometry      = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.driver_client_cert = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.extra_capabilities = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.filter_function    = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.goodness_function  = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.iser_helper        = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.iser_port          = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.lvm_type           = auto {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.replication_device = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.report_discard_supported = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.reserved_percentage = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.scst_target_driver = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.storage_protocol   = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.target_ip_address  = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.target_port        = 3260 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.trace_flags        = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.volume_clear       = zero {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] lvmdriver-1.volumes_dir        = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_notifications.driver = [] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_notifications.retry = -1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] key_manager.fixed_key          = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican.barbican_api_version  = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican.barbican_endpoint     = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican.barbican_endpoint_type = public {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican.barbican_region_name  = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican.cafile                = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican.certfile              = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican.collect_timing        = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican.insecure              = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican.keyfile               = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican.number_of_retries     = 60 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican.retry_delay           = 1 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican.send_service_user_token = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican.split_loggers         = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican.timeout               = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican.verify_ssl            = True {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican.verify_ssl_path       = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican_service_user.auth_section = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican_service_user.auth_type = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican_service_user.cafile   = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican_service_user.certfile = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican_service_user.collect_timing = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican_service_user.insecure = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican_service_user.keyfile  = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican_service_user.split_loggers = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] barbican_service_user.timeout  = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] vault.approle_role_id          = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] vault.approle_secret_id        = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] vault.kv_mountpoint            = secret {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] vault.kv_path                  = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] vault.kv_version               = 2 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] vault.namespace                = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] vault.root_token_id            = **** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] vault.ssl_ca_crt_file          = None {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] vault.timeout                  = 60.0 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] vault.use_ssl                  = False {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 00:55:40 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] ******************************************************************************** {{(pid=75886) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 06 00:55:40 devstack sudo[76056]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:40 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.754s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:40 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:40 devstack sudo[76065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 06 00:55:40 devstack sudo[76065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:40 devstack sudo[76065]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:40 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.599s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:40 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 00:55:40 devstack cinder-volume[76051]: INFO cinder.brick.local_dev.lvm [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jun 06 00:55:40 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:40 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:40 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:40 devstack sudo[76293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 06 00:55:40 devstack sudo[76293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:41 devstack sudo[76293]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:41 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.578s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:41 devstack cinder-volume[76051]: DEBUG cinder.brick.local_dev.lvm [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76051) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jun 06 00:55:41 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:41 devstack sudo[76481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 06 00:55:41 devstack sudo[76481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:43 devstack sudo[76481]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:43 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.544s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:43 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:43 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:43 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:43 devstack sudo[76781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 06 00:55:43 devstack sudo[76781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:43 devstack sudo[76781]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:43 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.687s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:43 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:43 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:43 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:43 devstack sudo[76839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jun 06 00:55:43 devstack sudo[76839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:44 devstack sudo[76839]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:44 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.604s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:44 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:44 devstack sudo[76843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 06 00:55:44 devstack sudo[76843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:45 devstack sudo[76843]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:45 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:45 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:45 devstack sudo[76850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 06 00:55:45 devstack sudo[76850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:45 devstack sudo[76850]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:45 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:45 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:45 devstack sudo[76853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 06 00:55:45 devstack sudo[76853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:46 devstack sudo[76853]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:46 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.710s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:46 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:46 devstack sudo[76859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 06 00:55:46 devstack sudo[76859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:47 devstack sudo[76859]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:47 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.758s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:47 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:47 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:47 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:47 devstack sudo[76868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 06 00:55:47 devstack sudo[76868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:48 devstack sudo[76868]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:48 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.840s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:48 devstack cinder-volume[76051]: INFO cinder.volume.drivers.lvm [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jun 06 00:55:48 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:48 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:48 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:48 devstack sudo[76886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 06 00:55:48 devstack sudo[76886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:48 devstack sudo[76886]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:48 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.640s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:48 devstack cinder-volume[76051]: DEBUG cinder.volume.drivers.lvm [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Updating volume stats {{(pid=76051) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 06 00:55:48 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:48 devstack sudo[76994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 06 00:55:48 devstack sudo[76994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:49 devstack cinder-volume[75886]: DEBUG dbcounter [-] [75886] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75886) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 00:55:49 devstack sudo[76994]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:49 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:49 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:49 devstack sudo[77136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 06 00:55:49 devstack sudo[77136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:50 devstack sudo[77136]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:50 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:50 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:50 devstack sudo[77143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 06 00:55:50 devstack sudo[77143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:50 devstack sudo[77143]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:50 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.605s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:50 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:50 devstack sudo[77146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 06 00:55:50 devstack sudo[77146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:51 devstack sudo[77146]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:51 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.602s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:51 devstack cinder-volume[76051]: INFO cinder.volume.driver [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Driver hasn't implemented _init_vendor_properties()
Jun 06 00:55:51 devstack cinder-volume[76051]: DEBUG cinder.volume.driver [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76051) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Jun 06 00:55:51 devstack cinder-volume[76051]: DEBUG oslo_db.sqlalchemy.engines [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76051) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 06 00:55:51 devstack cinder-volume[76051]: DEBUG dbcounter [-] [76051] Writer thread running {{(pid=76051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 06 00:55:51 devstack cinder-volume[76051]: DEBUG cinder.db.sqlalchemy.api [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Building query based on filter {{(pid=76051) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Jun 06 00:55:51 devstack cinder-volume[76051]: DEBUG cinder.image.image_utils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76051) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Jun 06 00:55:51 devstack cinder-volume[76051]: INFO cinder.keymgr.migration [None req-9c5cdd91-e4b7-4be1-9fe3-b16789c2ab26 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 06 00:55:51 devstack cinder-volume[76051]: DEBUG cinder.volume.drivers.lvm [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Updating volume stats {{(pid=76051) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 06 00:55:51 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:51 devstack sudo[77150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 06 00:55:51 devstack sudo[77150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:51 devstack sudo[77150]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:51 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.584s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:51 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:51 devstack sudo[77154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 06 00:55:51 devstack sudo[77154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:52 devstack sudo[77154]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:52 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:52 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:52 devstack sudo[77157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 06 00:55:52 devstack sudo[77157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:53 devstack sudo[77157]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:53 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.619s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:53 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:53 devstack sudo[77165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 06 00:55:53 devstack sudo[77165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:53 devstack sudo[77165]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:53 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:53 devstack cinder-volume[76051]: DEBUG cinder.manager [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Notifying Schedulers of capabilities ... {{(pid=76051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 00:55:53 devstack cinder-volume[76051]: INFO cinder.volume.manager [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Driver initialization completed successfully.
Jun 06 00:55:53 devstack cinder-volume[76051]: INFO cinder.manager [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Initiating service 2 cleanup
Jun 06 00:55:53 devstack cinder-volume[76051]: INFO cinder.manager [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Service 2 cleanup completed.
Jun 06 00:55:53 devstack cinder-volume[76051]: DEBUG cinder.service [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Creating RPC server for service cinder-volume {{(pid=76051) start /opt/stack/cinder/cinder/service.py:231}}
Jun 06 00:55:53 devstack cinder-volume[76051]: DEBUG cinder.service [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76051) start /opt/stack/cinder/cinder/service.py:237}}
Jun 06 00:55:53 devstack cinder-volume[76051]: INFO cinder.volume.manager [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jun 06 00:55:53 devstack cinder-volume[76051]: DEBUG cinder.volume.drivers.lvm [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Updating volume stats {{(pid=76051) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 06 00:55:53 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:54 devstack sudo[77169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 06 00:55:54 devstack sudo[77169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:54 devstack sudo[77169]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:54 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:54 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:54 devstack sudo[77173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 06 00:55:54 devstack sudo[77173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:55 devstack sudo[77173]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:55 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:55 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:55 devstack sudo[77176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 06 00:55:55 devstack sudo[77176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:55 devstack sudo[77176]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:55 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.593s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:55 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:55:55 devstack sudo[77233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 06 00:55:55 devstack sudo[77233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:55:56 devstack sudo[77233]: pam_unix(sudo:session): session closed for user root
Jun 06 00:55:56 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.583s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:55:56 devstack cinder-volume[76051]: INFO cinder.volume.manager [None req-934a0a67-185a-4754-9883-5086a6ce1a06 None None] Driver post RPC initialization completed successfully.
Jun 06 00:56:06 devstack cinder-volume[76051]: DEBUG dbcounter [-] [76051] Writing DB stats cinder:SELECT=4 {{(pid=76051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 00:56:06 devstack cinder-volume[76051]: DEBUG dbcounter [-] [76051] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 00:56:59 devstack cinder-volume[76051]: DEBUG oslo_service.periodic_task [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 00:56:59 devstack cinder-volume[76051]: DEBUG cinder.volume.drivers.lvm [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Updating volume stats {{(pid=76051) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 06 00:56:59 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:56:59 devstack sudo[79463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 06 00:56:59 devstack sudo[79463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:57:00 devstack sudo[79463]: pam_unix(sudo:session): session closed for user root
Jun 06 00:57:00 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:57:00 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:57:00 devstack sudo[79466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 06 00:57:00 devstack sudo[79466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:57:00 devstack sudo[79466]: pam_unix(sudo:session): session closed for user root
Jun 06 00:57:00 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.587s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:57:00 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:57:00 devstack sudo[79469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 06 00:57:00 devstack sudo[79469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:57:01 devstack sudo[79469]: pam_unix(sudo:session): session closed for user root
Jun 06 00:57:01 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.587s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:57:01 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:57:01 devstack sudo[79480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 06 00:57:01 devstack sudo[79480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:57:01 devstack sudo[79480]: pam_unix(sudo:session): session closed for user root
Jun 06 00:57:01 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:57:01 devstack cinder-volume[76051]: DEBUG cinder.manager [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Notifying Schedulers of capabilities ... {{(pid=76051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 00:57:59 devstack cinder-volume[76051]: DEBUG oslo_service.periodic_task [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 00:57:59 devstack cinder-volume[76051]: DEBUG cinder.volume.drivers.lvm [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Updating volume stats {{(pid=76051) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 06 00:57:59 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:57:59 devstack sudo[82332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 06 00:57:59 devstack sudo[82332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:57:59 devstack sudo[82332]: pam_unix(sudo:session): session closed for user root
Jun 06 00:57:59 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.576s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:57:59 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:58:00 devstack sudo[82335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 06 00:58:00 devstack sudo[82335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:58:00 devstack sudo[82335]: pam_unix(sudo:session): session closed for user root
Jun 06 00:58:00 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:58:00 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:58:00 devstack sudo[82338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 06 00:58:00 devstack sudo[82338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:58:01 devstack sudo[82338]: pam_unix(sudo:session): session closed for user root
Jun 06 00:58:01 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.560s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:58:01 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:58:01 devstack sudo[82341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 06 00:58:01 devstack sudo[82341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:58:01 devstack sudo[82341]: pam_unix(sudo:session): session closed for user root
Jun 06 00:58:01 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.562s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:58:01 devstack cinder-volume[76051]: DEBUG cinder.manager [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Notifying Schedulers of capabilities ... {{(pid=76051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 00:58:06 devstack cinder-volume[76051]: DEBUG dbcounter [-] [76051] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 00:58:59 devstack cinder-volume[76051]: DEBUG oslo_service.periodic_task [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 00:58:59 devstack cinder-volume[76051]: DEBUG cinder.volume.drivers.lvm [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Updating volume stats {{(pid=76051) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 06 00:58:59 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:58:59 devstack sudo[84284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 06 00:58:59 devstack sudo[84284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:58:59 devstack sudo[84284]: pam_unix(sudo:session): session closed for user root
Jun 06 00:58:59 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.575s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:58:59 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:59:00 devstack sudo[84304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 06 00:59:00 devstack sudo[84304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:59:00 devstack sudo[84304]: pam_unix(sudo:session): session closed for user root
Jun 06 00:59:00 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.593s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:59:00 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:59:00 devstack sudo[84336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 06 00:59:00 devstack sudo[84336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:59:01 devstack sudo[84336]: pam_unix(sudo:session): session closed for user root
Jun 06 00:59:01 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.592s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:59:01 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:59:01 devstack sudo[84359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 06 00:59:01 devstack sudo[84359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 00:59:01 devstack sudo[84359]: pam_unix(sudo:session): session closed for user root
Jun 06 00:59:01 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.580s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 00:59:01 devstack cinder-volume[76051]: DEBUG cinder.manager [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Notifying Schedulers of capabilities ... {{(pid=76051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 00:59:59 devstack cinder-volume[76051]: DEBUG oslo_service.periodic_task [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76051) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 00:59:59 devstack cinder-volume[76051]: DEBUG cinder.volume.drivers.lvm [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Updating volume stats {{(pid=76051) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 06 00:59:59 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 00:59:59 devstack sudo[85324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 06 00:59:59 devstack sudo[85324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:00:00 devstack sudo[85324]: pam_unix(sudo:session): session closed for user root
Jun 06 01:00:00 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:00:00 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:00:00 devstack sudo[85373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 06 01:00:00 devstack sudo[85373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:00:00 devstack sudo[85373]: pam_unix(sudo:session): session closed for user root
Jun 06 01:00:00 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:00:00 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:00:00 devstack sudo[85401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 06 01:00:00 devstack sudo[85401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:00:01 devstack sudo[85401]: pam_unix(sudo:session): session closed for user root
Jun 06 01:00:01 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.581s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:00:01 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:00:01 devstack sudo[85407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 06 01:00:01 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:00:01 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root
Jun 06 01:00:01 devstack cinder-volume[76051]: DEBUG oslo_concurrency.processutils [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=76051) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:00:01 devstack cinder-volume[76051]: DEBUG cinder.manager [None req-62a6534c-2ee5-4d6c-89f5-8fa16926bee9 None None] Notifying Schedulers of capabilities ... {{(pid=76051) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:00:06 devstack cinder-volume[76051]: DEBUG dbcounter [-] [76051] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76051) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:00:13 devstack cinder-volume[75886]: INFO oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] Caught SIGTERM, stopping children
Jun 06 01:00:13 devstack cinder-volume[75886]: DEBUG oslo_concurrency.lockutils [None req-230b16de-8245-494e-bd94-660435466417 None None] Acquiring lock "singleton_lock" {{(pid=75886) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 06 01:00:13 devstack cinder-volume[75886]: DEBUG oslo_concurrency.lockutils [None req-230b16de-8245-494e-bd94-660435466417 None None] Acquired lock "singleton_lock" {{(pid=75886) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 06 01:00:13 devstack cinder-volume[75886]: DEBUG oslo_concurrency.lockutils [None req-230b16de-8245-494e-bd94-660435466417 None None] Releasing lock "singleton_lock" {{(pid=75886) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 06 01:00:13 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] Stop services. {{(pid=75886) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 06 01:00:13 devstack cinder-volume[75886]: DEBUG oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] Killing children. {{(pid=75886) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 06 01:00:13 devstack cinder-volume[75886]: INFO oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] Waiting on 1 children to exit
Jun 06 01:00:18 devstack cinder-volume[76051]: DEBUG oslo_concurrency.lockutils [None req-230b16de-8245-494e-bd94-660435466417 None None] Acquiring lock "singleton_lock" {{(pid=76051) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 06 01:00:18 devstack cinder-volume[76051]: DEBUG oslo_concurrency.lockutils [None req-230b16de-8245-494e-bd94-660435466417 None None] Acquired lock "singleton_lock" {{(pid=76051) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 06 01:00:18 devstack cinder-volume[76051]: DEBUG oslo_concurrency.lockutils [None req-230b16de-8245-494e-bd94-660435466417 None None] Releasing lock "singleton_lock" {{(pid=76051) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 06 01:00:18 devstack cinder-volume[76051]: WARNING amqp [None req-230b16de-8245-494e-bd94-660435466417 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 06 01:00:18 devstack cinder-volume[76051]: WARNING amqp [None req-230b16de-8245-494e-bd94-660435466417 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 06 01:00:18 devstack cinder-volume[75886]: INFO oslo_service.backend._eventlet.service [None req-230b16de-8245-494e-bd94-660435466417 None None] Child 76051 exited with status 0
Jun 06 01:00:21 devstack cinder-volume[85799]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85799) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 06 01:00:21 devstack cinder-volume[85799]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85799) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 06 01:00:21 devstack cinder-volume[85799]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85799) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 06 01:00:21 devstack cinder-volume[85799]: INFO dbcounter [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Registered counter for database cinder
Jun 06 01:00:21 devstack cinder-volume[85799]: DEBUG oslo_db.sqlalchemy.engines [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85799) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG dbcounter [-] [85799] Writer thread running {{(pid=85799) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 06 01:00:22 devstack cinder-volume[85799]: INFO cinder.rpc [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 06 01:00:22 devstack cinder-volume[85799]: INFO cinder.rpc [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_db.sqlalchemy.engines [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85799) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 06 01:00:22 devstack cinder-volume[85799]: INFO cinder.volume.manager [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Determined volume DB was empty at startup.
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG cinder.volume.manager [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85799) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Jun 06 01:00:22 devstack cinder-volume[85799]: INFO cinder.volume.manager [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 06 01:00:22 devstack cinder-volume[85799]: WARNING stevedore.named [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 06 01:00:22 devstack cinder-volume[85799]: WARNING castellan.key_manager [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 06 01:00:22 devstack cinder-volume[85799]: WARNING cinder.keymgr.conf_key_mgr [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 06 01:00:22 devstack cinder-volume[85799]: INFO cinder.volume.manager [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_db.sqlalchemy.engines [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85799) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 06 01:00:22 devstack cinder-volume[85799]: INFO oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Starting 1 workers
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Started child 85936 {{(pid=85799) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Full set of CONF: {{(pid=85799) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] ******************************************************************************** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Configuration options gathered from: {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] ================================================================================ {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] allow_availability_zone_fallback = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] allow_compression_on_image_upload = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85936]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0)
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] allowed_direct_url_schemes     = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] api_rate_limit                 = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] auth_strategy                  = keystone {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_availability_zone      = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_host                   = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_name                   = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_stats_polling_interval = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backup_api_class               = cinder.backup.api.API {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backup_name_template           = backup-%s {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backup_use_same_host           = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backup_use_temp_snapshot       = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] chap_password                  = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] chap_username                  =  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cinder_internal_tenant_project_id = d3264f1d847f47068098ab5d399b216e {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cinder_internal_tenant_user_id = f5b2a8ad4db141ecba607206934a4a15 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cluster                        = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] compression_format             = gzip {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] config_dir                     = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] config_source                  = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] control_exchange               = openstack {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] debug                          = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] default_availability_zone      = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] default_group_type             = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] default_volume_type            = QuobyteHD {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] disk_geometry                  = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] driver_client_cert             = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] driver_client_cert_key         = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] driver_data_namespace          = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] driver_ssl_cert_path           = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] driver_ssl_cert_verify         = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] driver_use_ssl                 = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] enable_new_services            = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] enable_unsupported_driver      = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] enforce_multipath_for_image_xfer = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] filter_function                = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance_api_insecure            = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance_api_servers             = ['http://192.168.122.246/image'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance_api_ssl_compression     = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance_ca_certificates_file    = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance_certfile                = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance_keyfile                 = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance_num_retries             = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance_request_timeout         = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] goodness_function              = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] graceful_shutdown_timeout      = 5 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] group_api_class                = cinder.group.api.API {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] host                           = devstack {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] image_compress_on_upload       = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] image_conversion_address_space_limit = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] image_conversion_cpu_limit     = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] image_conversion_disable       = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] image_upload_use_cinder_backend = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] image_upload_use_internal_tenant = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] image_volume_cache_enabled     = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] image_volume_cache_max_count   = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] image_volume_cache_max_size_gb = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] init_host_max_objects_retrieval = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] iscsi_target_flags             =  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] iscsi_write_cache              = on {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] iser_helper                    = tgtadm {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] iser_ip_address                = 192.168.122.246 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] iser_port                      = 3260 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] log_color                      = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] log_config_append              = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 06 01:00:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85936) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] log_dir                        = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] log_file                       = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] log_options                    = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] log_rotate_interval            = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] log_rotate_interval_type       = days {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] log_rotation_type              = none {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] max_age                        = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] max_logfile_count              = 30 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] max_logfile_size_mb            = 200 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] max_over_subscription_ratio    = 20.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] message_reap_interval          = 86400 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] message_ttl                    = 2592000 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] migration_create_volume_timeout_secs = 300 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] monkey_patch                   = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] monkey_patch_modules           = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] my_ip                          = 192.168.122.246 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] no_snapshot_gb_quota           = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] num_iser_scan_tries            = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] num_shell_tries                = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] num_volume_device_scan_tries   = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] nvmeof_conn_info_version       = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] nvmet_ns_id                    = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] nvmet_port_id                  = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] osapi_max_limit                = 1000 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] osapi_volume_ext_list          = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] osapi_volume_listen_port       = 8776 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] osapi_volume_use_ssl           = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] osapi_volume_workers           = 2 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] per_volume_size_limit          = -1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] periodic_fuzzy_delay           = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] periodic_interval              = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] public_endpoint                = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] publish_errors                 = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] quota_backup_gigabytes         = 1000 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] quota_backups                  = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] quota_gigabytes                = 1000 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] quota_groups                   = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] quota_snapshots                = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] quota_volumes                  = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] rate_limit_burst               = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] rate_limit_except_level        = CRITICAL {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] rate_limit_interval            = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] reinit_driver_count            = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] replication_device             = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] report_discard_supported       = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] report_interval                = 120 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] reservation_clean_interval     = 86400 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] reservation_expire             = 86400 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] reserved_image_namespaces      = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] reserved_percentage            = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] rpc_response_timeout           = 120 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] run_external_periodic_tasks    = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] scst_target_driver             = iscsi {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] scst_target_iqn_name           = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] service_down_time              = 720 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] shell_completion               = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] snapshot_name_template         = snapshot-%s {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] split_loggers                  = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] state_path                     = /opt/stack/data/cinder {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] storage_availability_zone      = nova {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] storage_protocol               = iSCSI {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] syslog_log_facility            = LOG_USER {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] target_helper                  = lioadm {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] target_ip_address              = 192.168.122.246 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] target_port                    = 3260 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] target_protocol                = iscsi {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] target_secondary_ip_addresses  = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] trace_flags                    = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] transport_url                  = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] until_refresh                  = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] use_chap_auth                  = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] use_default_quota_class        = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] use_journal                    = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] use_json                       = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] use_multipath_for_image_xfer   = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] use_stderr                     = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] use_syslog                     = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] verify_glance_signatures       = enabled {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] volume_api_class               = cinder.volume.api.API {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] volume_backend_name            = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] volume_clear                   = zero {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] volume_clear_ionice            = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] volume_clear_size              = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] volume_copy_bps_limit          = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] volume_dd_blocksize            = 1M {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] volume_name_template           = volume-%s {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] volume_service_inithost_offload = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] volume_usage_audit_period      = month {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] zoning_mode                    = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_concurrency.disable_process_locking = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.admin_password = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.admin_token = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.admin_user  = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.auth_port   = 35357 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.auth_protocol = https {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.auth_section = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.auth_type   = password {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.auth_uri    = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.auth_version = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.cache       = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.certfile    = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.identity_uri = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.include_service_catalog = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.insecure    = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.interface   = public {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.keyfile     = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.memcache_password =  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.memcache_username =  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.region_name = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.service_token_roles_required = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.service_type = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.246/identity {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.backend                  = dogpile.cache.null {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.backend_argument         = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.backend_expiration_time  = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85936) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.config_prefix            = cache.oslo {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.debug_cache_backend      = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.enable_retry_client      = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.enable_socket_keepalive  = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.enabled                  = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.quobyte [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 06 01:00:22 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.quobyte [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.enforce_fips_mode        = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.expiration_time          = 600 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Running cmd (subprocess): mount.quobyte {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.hashclient_retry_attempts = 2 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.memcache_dead_retry      = 300 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.memcache_sasl_enabled    = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.password                 = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.proxies                  = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.redis_db                 = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.redis_server             = localhost:6379 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.retry_attempts           = 2 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.retry_delay              = 0.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.socket_keepalive_count   = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.socket_keepalive_idle    = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.socket_keepalive_interval = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.socket_timeout           = 1.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.tls_allowed_ciphers      = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.tls_cafile               = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.tls_certfile             = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.tls_enabled              = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.tls_keyfile              = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cache.username                 = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] coordination.backend_url       = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.asyncio_connection    = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.asyncio_slave_connection = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.backend               = sqlalchemy {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.connection            = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.connection_debug      = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.connection_parameters =  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.connection_recycle_time = 3600 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.connection_trace      = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.db_inc_retry_interval = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.db_max_retries        = 20 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.db_max_retry_interval = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.db_retry_interval     = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.max_overflow          = 50 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.max_pool_size         = 5 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.max_retries           = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.mysql_wsrep_sync_wait = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.pool_timeout          = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.retry_interval        = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.slave_connection      = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.sqlite_synchronous    = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.synchronous_reader    = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] database.use_db_reconnect      = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] profiler.connection_string     = messaging:// {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] profiler.enabled               = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] profiler.es_doc_type           = notification {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] profiler.es_scroll_size        = 10000 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] profiler.es_scroll_time        = 2m {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] profiler.filter_error_trace    = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] profiler.hmac_keys             = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] profiler.sentinel_service_name = mymaster {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] profiler.socket_timeout        = 0.1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] profiler.trace_requests        = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] profiler.trace_sqlalchemy      = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] profiler_jaeger.process_tags   = {} {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] profiler_jaeger.service_name_prefix = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] profiler_otlp.service_name_prefix = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_policy.enforce_new_defaults = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: WARNING oslo_config.cfg [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_policy.enforce_scope      = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_policy.policy_default_rule = default {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] privsep_osbrick.group          = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] privsep_osbrick.helper_command = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] privsep_osbrick.user           = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cinder_sys_admin.group         = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cinder_sys_admin.helper_command = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] cinder_sys_admin.user          = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] service_user.auth_section      = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] service_user.auth_type         = password {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] service_user.cafile            = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] service_user.certfile          = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] service_user.collect_timing    = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] service_user.insecure          = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] service_user.keyfile           = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] service_user.send_service_user_token = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] service_user.split_loggers     = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] service_user.timeout           = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance.auth_section            = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance.auth_type               = password {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance.certfile                = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance.collect_timing          = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance.insecure                = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance.keyfile                 = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance.region_name             = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance.split_loggers           = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] glance.timeout                 = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.backend_availability_zone = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.chap_password = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.chap_username =  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.disk_geometry = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.driver_client_cert = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.driver_client_cert_key = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.driver_data_namespace = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.driver_use_ssl = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.extra_capabilities = {} {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.filter_function = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.goodness_function = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.iscsi_target_flags =  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.iscsi_write_cache = on {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.iser_ip_address = 192.168.122.246 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.iser_port     = 3260 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.nas_host      =  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.nas_login     = admin {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.nas_mount_options = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.nas_password  = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.nas_private_key =  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.nas_share_path =  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.num_shell_tries = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.quobyte_volume_url = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.replication_device = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.report_discard_supported = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.reserved_percentage = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.target_helper = tgtadm {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.target_ip_address = 192.168.122.246 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.target_port   = 3260 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.target_protocol = iscsi {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.trace_flags   = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.unique_fqdn_network = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.use_chap_auth = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.volume_backend_name = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.volume_clear  = zero {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.volume_clear_ionice = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.volume_clear_size = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_reports.file_event_handler = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_reports.log_dir           = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.backend_availability_zone = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.backend_host         = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.chap_password        = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.chap_username        = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.disk_geometry        = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.driver_client_cert   = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.driver_data_namespace = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.extra_capabilities   = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.filter_function      = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.goodness_function    = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.iser_helper          = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.iser_ip_address      = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.iser_port            = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.nas_host             = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.nas_login            = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.nas_mount_options    = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.nas_password         = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.nas_private_key      = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.nas_share_path       = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.num_shell_tries      = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.replication_device   = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.report_discard_supported = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.reserved_percentage  = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.scst_target_driver   = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.storage_protocol     = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.target_helper        = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.target_ip_address    = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.target_port          = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.target_prefix        = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.target_protocol      = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.trace_flags          = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.use_chap_auth        = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.volume_clear         = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.volume_clear_size    = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] QuobyteHD.volumes_dir          = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack quobyte-client[85990]: Reading configuration file: /etc/quobyte/client.cfg
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack quobyte-client[85990]: Invalid parameters found, error: missing mount point.
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack quobyte-client[85990]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack quobyte-client[85990]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_notifications.driver = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_notifications.retry = -1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] key_manager.fixed_key          = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican.barbican_api_version  = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican.barbican_endpoint     = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican.barbican_endpoint_type = public {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican.barbican_region_name  = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican.cafile                = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican.certfile              = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican.collect_timing        = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican.insecure              = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican.keyfile               = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican.number_of_retries     = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican.retry_delay           = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican.send_service_user_token = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican.split_loggers         = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican.timeout               = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican.verify_ssl            = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican.verify_ssl_path       = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican_service_user.auth_section = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican_service_user.auth_type = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican_service_user.cafile   = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican_service_user.certfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican_service_user.collect_timing = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican_service_user.insecure = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican_service_user.keyfile  = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican_service_user.split_loggers = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] barbican_service_user.timeout  = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] vault.approle_role_id          = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] vault.approle_secret_id        = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] vault.kv_mountpoint            = secret {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] vault.kv_path                  = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] vault.kv_version               = 2 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] vault.namespace                = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] vault.root_token_id            = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] vault.ssl_ca_crt_file          = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] vault.timeout                  = 60.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] vault.use_ssl                  = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:22 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] ******************************************************************************** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 06 01:00:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] CMD "mount.quobyte" returned: 1 in 0.214s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:00:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:00:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:00:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:00:22 devstack cinder-volume[85936]: INFO cinder.volume.drivers.quobyte [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee ...
Jun 06 01:00:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 -c /etc/quobyte/client-cinder.cfg {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:00:22 devstack sudo[86016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 -c /etc/quobyte/client-cinder.cfg
Jun 06 01:00:22 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:00:23 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root
Jun 06 01:00:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.772s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:00:23 devstack cinder-volume[85936]: INFO cinder.volume.drivers.quobyte [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee succeeded
Jun 06 01:00:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:00:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.788s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:00:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:00:23 devstack sudo[86091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:00:23 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:00:24 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.591s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:00:24 devstack cinder-volume[85936]: INFO cinder.volume.driver [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Driver hasn't implemented _init_vendor_properties()
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG cinder.volume.driver [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757926940918, 'free_capacity_gb': 1775.757926940918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85936) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG oslo_db.sqlalchemy.engines [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85936) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writer thread running {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG cinder.db.sqlalchemy.api [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Building query based on filter {{(pid=85936) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85936) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Jun 06 01:00:24 devstack cinder-volume[85936]: INFO cinder.keymgr.migration [None req-3eac1b49-272c-4619-8109-f2ee5220cf2e None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:00:24 devstack sudo[86094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:00:24 devstack sudo[86094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:00:24 devstack sudo[86094]: pam_unix(sudo:session): session closed for user root
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.595s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:00:24 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Driver initialization completed successfully.
Jun 06 01:00:24 devstack cinder-volume[85936]: INFO cinder.manager [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Initiating service 3 cleanup
Jun 06 01:00:24 devstack cinder-volume[85936]: INFO cinder.manager [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Service 3 cleanup completed.
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG cinder.service [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Creating RPC server for service cinder-volume {{(pid=85936) start /opt/stack/cinder/cinder/service.py:231}}
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG cinder.service [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85936) start /opt/stack/cinder/cinder/service.py:237}}
Jun 06 01:00:24 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:00:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:00:24 devstack sudo[86099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:00:24 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:00:25 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root
Jun 06 01:00:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.632s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:00:25 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d625cc4b-9dde-4517-9236-a1a7ddf77ef2 None None] Driver post RPC initialization completed successfully.
Jun 06 01:00:29 devstack cinder-volume[85799]: INFO oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Caught SIGTERM, stopping children
Jun 06 01:00:29 devstack cinder-volume[85799]: DEBUG oslo_concurrency.lockutils [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Acquiring lock "singleton_lock" {{(pid=85799) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 06 01:00:29 devstack cinder-volume[85799]: DEBUG oslo_concurrency.lockutils [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Acquired lock "singleton_lock" {{(pid=85799) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 06 01:00:29 devstack cinder-volume[85799]: DEBUG oslo_concurrency.lockutils [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Releasing lock "singleton_lock" {{(pid=85799) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 06 01:00:29 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Stop services. {{(pid=85799) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 06 01:00:29 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Killing children. {{(pid=85799) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 06 01:00:29 devstack cinder-volume[85799]: INFO oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Waiting on 1 children to exit
Jun 06 01:00:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Acquiring lock "singleton_lock" {{(pid=85936) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 06 01:00:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Acquired lock "singleton_lock" {{(pid=85936) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 06 01:00:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Releasing lock "singleton_lock" {{(pid=85936) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 06 01:00:33 devstack cinder-volume[85936]: WARNING amqp [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 06 01:00:33 devstack cinder-volume[85936]: WARNING amqp [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 06 01:00:33 devstack cinder-volume[85799]: INFO oslo_service.backend._eventlet.service [None req-4a783484-6d08-4f3c-937f-e5d6661b8711 None None] Child 85936 exited with status 0
Jun 06 01:00:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 06 01:00:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 06 01:00:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 06 01:00:36 devstack cinder-volume[86301]: INFO dbcounter [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] Registered counter for database cinder
Jun 06 01:00:36 devstack cinder-volume[86301]: DEBUG oslo_db.sqlalchemy.engines [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86301) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 06 01:00:36 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writer thread running {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 06 01:00:36 devstack cinder-volume[86301]: INFO cinder.rpc [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 06 01:00:36 devstack cinder-volume[86301]: INFO cinder.rpc [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 06 01:00:36 devstack cinder-volume[86301]: DEBUG oslo_db.sqlalchemy.engines [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86301) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 06 01:00:37 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] Determined volume DB was empty at startup.
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86301) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Jun 06 01:00:37 devstack cinder-volume[86301]: WARNING stevedore.named [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 06 01:00:37 devstack cinder-volume[86301]: WARNING castellan.key_manager [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 06 01:00:37 devstack cinder-volume[86301]: WARNING cinder.keymgr.conf_key_mgr [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 06 01:00:37 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_db.sqlalchemy.engines [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86301) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 06 01:00:37 devstack cinder-volume[86301]: INFO oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] Starting 1 workers
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] Started child 86581 {{(pid=86301) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] Full set of CONF: {{(pid=86301) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] ******************************************************************************** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] Configuration options gathered from: {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] ================================================================================ {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] allow_availability_zone_fallback = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] allow_compression_on_image_upload = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] allowed_direct_url_schemes     = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] api_rate_limit                 = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] auth_strategy                  = keystone {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_availability_zone      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_host                   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_name                   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_stats_polling_interval = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backup_api_class               = cinder.backup.api.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backup_name_template           = backup-%s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86581]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0)
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backup_use_same_host           = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backup_use_temp_snapshot       = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] chap_password                  = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] chap_username                  =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cinder_internal_tenant_project_id = d3264f1d847f47068098ab5d399b216e {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cinder_internal_tenant_user_id = f5b2a8ad4db141ecba607206934a4a15 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cluster                        = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] compression_format             = gzip {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] compute_api_class              = cinder.compute.nova.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] config_dir                     = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] config_source                  = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] control_exchange               = openstack {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] debug                          = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] default_availability_zone      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] default_group_type             = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] default_volume_type            = QuobyteHD {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] disk_geometry                  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] driver_client_cert             = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] driver_client_cert_key         = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] driver_data_namespace          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] driver_ssl_cert_path           = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] driver_ssl_cert_verify         = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] driver_use_ssl                 = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] enable_new_services            = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] enable_unsupported_driver      = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] enabled_backends               = ['QuobyteHD'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] enforce_multipath_for_image_xfer = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] filter_function                = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance_api_insecure            = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance_api_servers             = ['http://192.168.122.246/image'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance_api_ssl_compression     = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance_ca_certificates_file    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance_catalog_info            = image:glance:publicURL {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance_certfile                = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance_keyfile                 = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance_num_retries             = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance_request_timeout         = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] goodness_function              = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] graceful_shutdown_timeout      = 5 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] group_api_class                = cinder.group.api.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] host                           = devstack {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] image_compress_on_upload       = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] image_conversion_address_space_limit = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] image_conversion_cpu_limit     = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] image_conversion_disable       = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] image_upload_use_cinder_backend = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] image_upload_use_internal_tenant = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] image_volume_cache_enabled     = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] image_volume_cache_max_count   = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] image_volume_cache_max_size_gb = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] init_host_max_objects_retrieval = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] instance_format                = [instance: %(uuid)s]  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] iscsi_target_flags             =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] iscsi_write_cache              = on {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] iser_helper                    = tgtadm {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] iser_ip_address                = 192.168.122.246 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] iser_port                      = 3260 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] log_color                      = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] log_config_append              = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] log_dir                        = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] log_file                       = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] log_options                    = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] log_rotate_interval            = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] log_rotate_interval_type       = days {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] log_rotation_type              = none {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] max_age                        = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] max_logfile_count              = 30 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] max_logfile_size_mb            = 200 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] max_over_subscription_ratio    = 20.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] message_reap_interval          = 86400 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] message_ttl                    = 2592000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] migration_create_volume_timeout_secs = 300 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] monkey_patch                   = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] monkey_patch_modules           = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] my_ip                          = 192.168.122.246 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] no_snapshot_gb_quota           = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] num_iser_scan_tries            = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] num_shell_tries                = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] num_volume_device_scan_tries   = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] nvmeof_conn_info_version       = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] nvmet_ns_id                    = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] nvmet_port_id                  = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] osapi_max_limit                = 1000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] osapi_volume_ext_list          = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] osapi_volume_listen_port       = 8776 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] osapi_volume_use_ssl           = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] osapi_volume_workers           = 2 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] per_volume_size_limit          = -1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] periodic_fuzzy_delay           = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] periodic_interval              = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] public_endpoint                = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] publish_errors                 = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] quota_backup_gigabytes         = 1000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86581) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] quota_backups                  = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] quota_gigabytes                = 1000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] quota_groups                   = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] quota_snapshots                = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] quota_volumes                  = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] rate_limit_burst               = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] rate_limit_except_level        = CRITICAL {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] rate_limit_interval            = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] reinit_driver_count            = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] replication_device             = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] report_discard_supported       = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] report_interval                = 120 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] reservation_clean_interval     = 86400 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] reservation_expire             = 86400 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] reserved_image_namespaces      = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] reserved_percentage            = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] rpc_response_timeout           = 120 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] run_external_periodic_tasks    = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] scst_target_driver             = iscsi {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] scst_target_iqn_name           = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] service_down_time              = 720 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] shell_completion               = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] snapshot_name_template         = snapshot-%s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] split_loggers                  = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] state_path                     = /opt/stack/data/cinder {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] storage_availability_zone      = nova {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] storage_protocol               = iSCSI {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] syslog_log_facility            = LOG_USER {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] target_helper                  = lioadm {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] target_ip_address              = 192.168.122.246 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] target_port                    = 3260 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] target_protocol                = iscsi {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] target_secondary_ip_addresses  = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] trace_flags                    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] transport_url                  = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] until_refresh                  = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] use_chap_auth                  = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] use_default_quota_class        = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] use_journal                    = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] use_json                       = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] use_multipath_for_image_xfer   = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] use_stderr                     = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] use_syslog                     = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] verify_glance_signatures       = enabled {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] volume_api_class               = cinder.volume.api.API {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] volume_backend_name            = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] volume_clear                   = zero {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] volume_clear_ionice            = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] volume_clear_size              = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] volume_copy_bps_limit          = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] volume_dd_blocksize            = 1M {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] volume_name_template           = volume-%s {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] volume_service_inithost_offload = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] volume_usage_audit_period      = month {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] zoning_mode                    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_concurrency.disable_process_locking = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.admin_password = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.admin_token = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.admin_user  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.auth_admin_prefix =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.auth_port   = 35357 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.auth_protocol = https {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.auth_section = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.auth_type   = password {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.auth_uri    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.auth_version = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.cache       = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.certfile    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.identity_uri = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.include_service_catalog = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.insecure    = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.interface   = public {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.keyfile     = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.memcache_password =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.memcache_username =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.region_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.service_token_roles_required = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.service_type = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.246/identity {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.backend                  = dogpile.cache.null {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.backend_argument         = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.backend_expiration_time  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.config_prefix            = cache.oslo {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.debug_cache_backend      = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.enable_retry_client      = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.enable_socket_keepalive  = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.enabled                  = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.enforce_fips_mode        = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.expiration_time          = 600 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.hashclient_retry_attempts = 2 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.memcache_dead_retry      = 300 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.memcache_pool_maxsize    = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.memcache_sasl_enabled    = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.password                 = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.proxies                  = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.redis_db                 = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.redis_server             = localhost:6379 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.retry_attempts           = 2 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.retry_delay              = 0.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.socket_keepalive_count   = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.socket_keepalive_idle    = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.socket_keepalive_interval = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.socket_timeout           = 1.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.tls_allowed_ciphers      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.tls_cafile               = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.tls_certfile             = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.tls_enabled              = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.tls_keyfile              = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cache.username                 = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] coordination.backend_url       = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.asyncio_connection    = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.asyncio_slave_connection = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.backend               = sqlalchemy {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.connection            = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.connection_debug      = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.connection_parameters =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.connection_recycle_time = 3600 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.connection_trace      = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.db_inc_retry_interval = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.db_max_retries        = 20 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.db_max_retry_interval = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.db_retry_interval     = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.max_overflow          = 50 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.max_pool_size         = 5 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.max_retries           = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.mysql_wsrep_sync_wait = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86581) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 06 01:00:37 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.quobyte [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.pool_timeout          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.quobyte [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.retry_interval        = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.slave_connection      = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.sqlite_synchronous    = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.synchronous_reader    = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] database.use_db_reconnect      = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Running cmd (subprocess): mount.quobyte {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] profiler.connection_string     = messaging:// {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] profiler.enabled               = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] profiler.es_doc_type           = notification {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] profiler.es_scroll_size        = 10000 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] profiler.es_scroll_time        = 2m {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] profiler.filter_error_trace    = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] profiler.hmac_keys             = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] profiler.sentinel_service_name = mymaster {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] profiler.socket_timeout        = 0.1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] profiler.trace_requests        = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] profiler.trace_sqlalchemy      = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] profiler_jaeger.process_tags   = {} {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] profiler_jaeger.service_name_prefix = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] profiler_otlp.service_name_prefix = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_policy.enforce_new_defaults = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: WARNING oslo_config.cfg [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_policy.enforce_scope      = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_policy.policy_default_rule = default {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_policy.policy_file        = policy.yaml {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] privsep_osbrick.group          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] privsep_osbrick.helper_command = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] privsep_osbrick.user           = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cinder_sys_admin.group         = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cinder_sys_admin.helper_command = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] cinder_sys_admin.user          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] service_user.auth_section      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] service_user.auth_type         = password {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] service_user.cafile            = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] service_user.certfile          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] service_user.collect_timing    = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] service_user.insecure          = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] service_user.keyfile           = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] service_user.send_service_user_token = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] service_user.split_loggers     = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] service_user.timeout           = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance.auth_section            = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance.auth_type               = password {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance.certfile                = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance.collect_timing          = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance.insecure                = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance.keyfile                 = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance.region_name             = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance.split_loggers           = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] glance.timeout                 = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.backend_availability_zone = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.chap_password = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.chap_username =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.disk_geometry = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.driver_client_cert = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.driver_client_cert_key = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.driver_data_namespace = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.driver_use_ssl = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.extra_capabilities = {} {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.filter_function = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.goodness_function = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.iscsi_target_flags =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.iscsi_write_cache = on {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.iser_helper   = tgtadm {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.iser_ip_address = 192.168.122.246 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.iser_port     = 3260 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.nas_host      =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.nas_login     = admin {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.nas_mount_options = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.nas_password  = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.nas_private_key =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.nas_share_path =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.num_shell_tries = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.quobyte_volume_url = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.replication_device = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.report_discard_supported = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.reserved_percentage = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.target_helper = tgtadm {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.target_ip_address = 192.168.122.246 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.target_port   = 3260 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.target_protocol = iscsi {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.trace_flags   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.unique_fqdn_network = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.use_chap_auth = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.volume_backend_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.volume_clear  = zero {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.volume_clear_ionice = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.volume_clear_size = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_reports.file_event_handler = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_reports.log_dir           = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.backend_availability_zone = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.backend_host         = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.chap_password        = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.chap_username        = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.chiscsi_conf         = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.disk_geometry        = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.driver_client_cert   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.driver_data_namespace = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.driver_use_ssl       = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.extra_capabilities   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.filter_function      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.goodness_function    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.iser_helper          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.iser_ip_address      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.iser_port            = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.iser_target_prefix   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.nas_host             = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.nas_login            = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.nas_mount_options    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.nas_password         = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.nas_private_key      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.nas_share_path       = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.nas_ssh_port         = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.num_shell_tries      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.nvmet_port_id        = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack quobyte-client[86588]: Reading configuration file: /etc/quobyte/client.cfg
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.replication_device   = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.report_discard_supported = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.reserved_percentage  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.scst_target_driver   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack quobyte-client[86588]: Invalid parameters found, error: missing mount point.
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.storage_protocol     = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.target_helper        = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack quobyte-client[86588]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] CMD "mount.quobyte" returned: 1 in 0.074s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:00:37 devstack quobyte-client[86588]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.target_ip_address    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.target_port          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.target_prefix        = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.target_protocol      = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.trace_flags          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.use_chap_auth        = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.volume_clear         = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.volume_clear_size    = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] QuobyteHD.volumes_dir          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.ssl      = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_notifications.driver = [] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_notifications.retry = -1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] key_manager.fixed_key          = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican.barbican_api_version  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican.barbican_endpoint     = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican.barbican_endpoint_type = public {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican.barbican_region_name  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican.cafile                = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican.certfile              = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican.collect_timing        = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican.insecure              = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican.keyfile               = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican.number_of_retries     = 60 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican.retry_delay           = 1 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican.send_service_user_token = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican.split_loggers         = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican.timeout               = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican.verify_ssl            = True {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican.verify_ssl_path       = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican_service_user.auth_section = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican_service_user.auth_type = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican_service_user.cafile   = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican_service_user.certfile = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican_service_user.collect_timing = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican_service_user.insecure = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican_service_user.keyfile  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican_service_user.split_loggers = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] barbican_service_user.timeout  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] vault.approle_role_id          = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] vault.approle_secret_id        = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] vault.kv_mountpoint            = secret {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] vault.kv_path                  = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] vault.kv_version               = 2 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] vault.namespace                = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] vault.root_token_id            = **** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] vault.ssl_ca_crt_file          = None {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] vault.timeout                  = 60.0 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] vault.use_ssl                  = False {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 06 01:00:37 devstack cinder-volume[86301]: DEBUG oslo_service.backend._eventlet.service [None req-bdbf39e0-bc87-443a-94a5-e13f5f75b10d None None] ******************************************************************************** {{(pid=86301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 06 01:00:37 devstack sudo[86589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:00:37 devstack sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:00:37 devstack sudo[86589]: pam_unix(sudo:session): session closed for user root
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.574s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:00:37 devstack cinder-volume[86581]: INFO cinder.volume.driver [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Driver hasn't implemented _init_vendor_properties()
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG cinder.volume.driver [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757926940918, 'free_capacity_gb': 1775.757926940918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86581) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG oslo_db.sqlalchemy.engines [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86581) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writer thread running {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG cinder.db.sqlalchemy.api [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Building query based on filter {{(pid=86581) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86581) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:00:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:00:37 devstack cinder-volume[86581]: INFO cinder.keymgr.migration [None req-8e4792c5-049f-438e-ac68-9f4262fe6de2 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 06 01:00:37 devstack sudo[86613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:00:37 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:00:38 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root
Jun 06 01:00:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.601s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:00:38 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:00:38 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Driver initialization completed successfully.
Jun 06 01:00:38 devstack cinder-volume[86581]: INFO cinder.manager [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Initiating service 3 cleanup
Jun 06 01:00:38 devstack cinder-volume[86581]: INFO cinder.manager [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Service 3 cleanup completed.
Jun 06 01:00:38 devstack cinder-volume[86581]: DEBUG cinder.service [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Creating RPC server for service cinder-volume {{(pid=86581) start /opt/stack/cinder/cinder/service.py:231}}
Jun 06 01:00:38 devstack cinder-volume[86581]: DEBUG cinder.service [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86581) start /opt/stack/cinder/cinder/service.py:237}}
Jun 06 01:00:38 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 06 01:00:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:00:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:00:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:00:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:00:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:00:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:00:38 devstack sudo[86632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:00:38 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:00:39 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root
Jun 06 01:00:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.582s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:00:39 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-bc40813f-fc85-440d-a8bd-364f2ecb5d5d None None] Driver post RPC initialization completed successfully.
Jun 06 01:00:47 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:00:48 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=2 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:00:49 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Flow 'volume_create_manager' (edc440b6-9270-4e5c-b330-b8f429dcc2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaca861a-6fc1-4708-add6-206de6bf1bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaca861a-6fc1-4708-add6-206de6bf1bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1771328413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6610b264-4e10-48b7-97ac-a25831acae34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e47fea1826e74f8ea98cb32040d02caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:01:35Z,use_quota=True,user_id='10eddd7f9d204eef8f57e311a7ff6547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98420f76-bd62-4339-9227-868d4e4ad24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98420f76-bd62-4339-9227-868d4e4ad24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf040408-6279-4937-aa61-86bc62594098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf040408-6279-4937-aa61-86bc62594098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6610b264-4e10-48b7-97ac-a25831acae34', 'volume_name': 'volume-6610b264-4e10-48b7-97ac-a25831acae34', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9e2dbf-72d9-4a4b-9bb7-a97b3336f7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9e2dbf-72d9-4a4b-9bb7-a97b3336f7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970b4752-f4d0-45ef-94ea-1777523303e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:01:35 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Volume 6610b264-4e10-48b7-97ac-a25831acae34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6610b264-4e10-48b7-97ac-a25831acae34', 'volume_size': 1}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1771328413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6610b264-4e10-48b7-97ac-a25831acae34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e47fea1826e74f8ea98cb32040d02caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:01:35Z,use_quota=True,user_id='10eddd7f9d204eef8f57e311a7ff6547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Creating volume 6610b264-4e10-48b7-97ac-a25831acae34 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:01:35 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:01:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6610b264-4e10-48b7-97ac-a25831acae34 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:01:35 devstack sudo[86984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6610b264-4e10-48b7-97ac-a25831acae34 1073741824
Jun 06 01:01:35 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:01:36 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root
Jun 06 01:01:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6610b264-4e10-48b7-97ac-a25831acae34 1073741824" returned: 0 in 0.936s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:01:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6610b264-4e10-48b7-97ac-a25831acae34 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:01:36 devstack sudo[87303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6610b264-4e10-48b7-97ac-a25831acae34
Jun 06 01:01:36 devstack sudo[87303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:01:36 devstack sudo[87303]: pam_unix(sudo:session): session closed for user root
Jun 06 01:01:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6610b264-4e10-48b7-97ac-a25831acae34" returned: 0 in 0.813s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:01:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:01:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:01:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970b4752-f4d0-45ef-94ea-1777523303e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6610b264-4e10-48b7-97ac-a25831acae34', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:01:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948627fa-d023-44f9-afa8-adc8ad226a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:01:37 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Volume volume-6610b264-4e10-48b7-97ac-a25831acae34 (6610b264-4e10-48b7-97ac-a25831acae34): created successfully
Jun 06 01:01:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948627fa-d023-44f9-afa8-adc8ad226a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:01:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Flow 'volume_create_manager' (edc440b6-9270-4e5c-b330-b8f429dcc2ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:01:37 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-5de157b2-c23a-4d1d-8ec8-12f39ec2f0e3 tempest-TaggedAttachmentsTest-783823475 None] Created volume successfully.
Jun 06 01:01:47 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:01:47 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:01:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-acf4d4e5-d059-4a89-be21-d9322753a63f tempest-BackendsCapabilitiesAdminTestsJSON-486567108 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757926940918, 'free_capacity_gb': 1775.757926940918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86581) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 06 01:01:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-052718ef-989a-43c4-92bd-5a0445380019 tempest-BackendsCapabilitiesAdminTestsJSON-486567108 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757926940918, 'free_capacity_gb': 1775.757926940918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86581) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 06 01:01:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:01:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:01:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:01:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:01:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:01:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:01:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:01:59 devstack sudo[87614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:01:59 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:01:59 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root
Jun 06 01:01:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.593s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:01:59 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Flow 'volume_create_manager' (a4ad9680-6ee1-4b51-9059-f17419f952cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb099cfa-ab49-4a3f-85fe-5fb69a6a8f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb099cfa-ab49-4a3f-85fe-5fb69a6a8f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-932235533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d24178-52ee-41bb-b265-9f04fc1ae1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e04522db670b419084779639a454d2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:02:10Z,use_quota=True,user_id='a4afec3dfe9042f488049fc1c2f51b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa565dc3-10db-4d52-bdf3-7b01fe9502f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa565dc3-10db-4d52-bdf3-7b01fe9502f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47349406-2954-4a60-b167-6ea37a31f314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47349406-2954-4a60-b167-6ea37a31f314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86d24178-52ee-41bb-b265-9f04fc1ae1d5', 'volume_name': 'volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa9fadb-f830-4307-b3e0-3bc673818a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa9fadb-f830-4307-b3e0-3bc673818a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc484ee6-1e98-4101-a41f-11eba05d99a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:09 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Volume 86d24178-52ee-41bb-b265-9f04fc1ae1d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5', 'volume_size': 1}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-932235533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d24178-52ee-41bb-b265-9f04fc1ae1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e04522db670b419084779639a454d2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:02:10Z,use_quota=True,user_id='a4afec3dfe9042f488049fc1c2f51b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Creating volume 86d24178-52ee-41bb-b265-9f04fc1ae1d5 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:02:09 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:02:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:09 devstack sudo[87722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5 1073741824
Jun 06 01:02:09 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:10 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5 1073741824" returned: 0 in 0.757s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:10 devstack sudo[87727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5
Jun 06 01:02:10 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:11 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5" returned: 0 in 0.774s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:02:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:02:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc484ee6-1e98-4101-a41f-11eba05d99a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34efad3-efdd-4151-98ae-61d980246769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:11 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Volume volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5 (86d24178-52ee-41bb-b265-9f04fc1ae1d5): created successfully
Jun 06 01:02:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34efad3-efdd-4151-98ae-61d980246769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Flow 'volume_create_manager' (a4ad9680-6ee1-4b51-9059-f17419f952cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:02:11 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-257132a8-4a80-46f7-ba53-2584fa10ed4a tempest-SnapshotsActionsTest-2018597254 None] Created volume successfully.
Jun 06 01:02:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:02:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:02:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] Creating offline snapshot 5dc388a8-7e03-4673-9a92-69d0ebd81974 of volume 86d24178-52ee-41bb-b265-9f04fc1ae1d5 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:02:12 devstack cinder-volume[86581]: INFO oslo.privsep.daemon [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpand356wx/privsep.sock']
Jun 06 01:02:12 devstack sudo[87740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpand356wx/privsep.sock
Jun 06 01:02:12 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:14 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:14 devstack cinder-volume[86581]: INFO oslo.privsep.daemon [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] Spawned new privsep daemon via rootwrap
Jun 06 01:02:14 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] Accepted privsep connection to /tmp/tmpand356wx/privsep.sock {{(pid=86581) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}}
Jun 06 01:02:14 devstack cinder-volume[86581]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jun 06 01:02:14 devstack cinder-volume[86581]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jun 06 01:02:14 devstack cinder-volume[86581]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jun 06 01:02:14 devstack cinder-volume[86581]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87752
Jun 06 01:02:14 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea5577a-e41a-41ea-8592-29d585716527]: (2,) {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:14 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[3904d04a-4d08-471f-a317-d5b6ea50adca]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:14 devstack sudo[87755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5
Jun 06 01:02:14 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:15 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:02:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Flow 'volume_create_manager' (be208bc6-b1d1-4f82-8dd2-3e9f92a63c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:02:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05b582d-4503-4f44-8588-86fad098be2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05b582d-4503-4f44-8588-86fad098be2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-985790041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bdb9c6-19b0-4422-b67b-e90aba035bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07cc1c009904270b5805b00ee26f25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:02:15Z,use_quota=True,user_id='9e2aae0295494738a77be1868ddf5951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f12dc79-f7f1-4997-b704-cf2ff62b4dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f12dc79-f7f1-4997-b704-cf2ff62b4dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00ce7df-0d5f-493b-b584-c713da2b848e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00ce7df-0d5f-493b-b584-c713da2b848e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38bdb9c6-19b0-4422-b67b-e90aba035bf6', 'volume_name': 'volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8420c4-8af3-48f5-928e-3656f0cd4a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8420c4-8af3-48f5-928e-3656f0cd4a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9a47ee-24d3-4edd-8b23-47007a1a7dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:15 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Volume 38bdb9c6-19b0-4422-b67b-e90aba035bf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6', 'volume_size': 1}
Jun 06 01:02:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:02:16 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5" returned: 0 in 1.706s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:16 devstack sudo[87766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 1G
Jun 06 01:02:16 devstack sudo[87766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:16 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:02:16 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Flow 'volume_create_manager' (655b3210-0105-4cfd-ab1d-68a1ed97e907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:02:16 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e97b21-b64e-415c-8a24-27cfa326beaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:16 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e97b21-b64e-415c-8a24-27cfa326beaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-932543310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e048081e14602bbb42c016fd1ea29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:02:16Z,use_quota=True,user_id='561a715eef114ae29a3dd09f23f01ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:16 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9c1556-a25e-4352-835d-382056c8d09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:16 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9c1556-a25e-4352-835d-382056c8d09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:16 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342d6eab-9a2e-4b9d-8582-ed04c3323ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:16 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342d6eab-9a2e-4b9d-8582-ed04c3323ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d', 'volume_name': 'volume-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:16 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b45669-5ce3-447f-aafa-8ad39068485b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:16 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b45669-5ce3-447f-aafa-8ad39068485b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:16 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a92d47c-1c5e-4e9a-b9d1-1803985b10ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:16 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Volume 7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d', 'volume_size': 1}
Jun 06 01:02:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:02:17 devstack sudo[87766]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 1G" returned: 0 in 1.047s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:17 devstack sudo[87771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974
Jun 06 01:02:17 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:18 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974" returned: 0 in 1.079s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:18 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 is being set with open permissions: ugo+rw
Jun 06 01:02:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:18 devstack sudo[87777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974
Jun 06 01:02:18 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:19 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974" returned: 0 in 0.840s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:19 devstack sudo[87782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.info
Jun 06 01:02:19 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:20 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.info" returned: 0 in 1.008s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:20 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.info is being set with open permissions: ugo+rw
Jun 06 01:02:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:20 devstack sudo[87785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.info
Jun 06 01:02:20 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:20 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.info" returned: 0 in 0.784s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.819s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:02:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.484s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:02:21 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-985790041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bdb9c6-19b0-4422-b67b-e90aba035bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07cc1c009904270b5805b00ee26f25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:02:15Z,use_quota=True,user_id='9e2aae0295494738a77be1868ddf5951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:02:21 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Creating volume 38bdb9c6-19b0-4422-b67b-e90aba035bf6 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:02:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:02:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:02:21 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:02:21 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:02:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:02:21 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:02:21 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:02:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:21 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-8882be4c-5ef5-4c01-afff-e3c73f7f2b9f tempest-SnapshotsActionsTest-2018597254 None] Create snapshot completed successfully
Jun 06 01:02:21 devstack sudo[87788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6 1073741824
Jun 06 01:02:21 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:21 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6 1073741824" returned: 0 in 0.911s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:22 devstack sudo[87795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6
Jun 06 01:02:22 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:22 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c3425d59-d711-49e6-9980-8a30441140a1 tempest-SnapshotsActionsTest-2018597254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:02:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6" returned: 0 in 0.891s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:02:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:02:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.403s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:02:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-932543310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e048081e14602bbb42c016fd1ea29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:02:16Z,use_quota=True,user_id='561a715eef114ae29a3dd09f23f01ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:02:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Creating volume 7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:02:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:02:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:02:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:02:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:02:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:02:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:02:22 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:02:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:22 devstack sudo[87798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d 1073741824
Jun 06 01:02:22 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9a47ee-24d3-4edd-8b23-47007a1a7dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9002ae-f25e-4054-bece-1bfefc8225cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:23 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Volume volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6 (38bdb9c6-19b0-4422-b67b-e90aba035bf6): created successfully
Jun 06 01:02:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9002ae-f25e-4054-bece-1bfefc8225cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Flow 'volume_create_manager' (be208bc6-b1d1-4f82-8dd2-3e9f92a63c15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:02:23 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-46b04e6d-8ccb-4b93-8ccd-5a1328ea0b47 tempest-DeleteServersTestJSON-1287173930 None] Created volume successfully.
Jun 06 01:02:23 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d 1073741824" returned: 0 in 0.931s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:23 devstack sudo[87805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d
Jun 06 01:02:23 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:24 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d" returned: 0 in 0.898s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:02:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:02:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c3425d59-d711-49e6-9980-8a30441140a1 tempest-SnapshotsActionsTest-2018597254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.951s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:02:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a92d47c-1c5e-4e9a-b9d1-1803985b10ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056d6e13-ead3-4113-8709-961dad84d2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:02:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-c3425d59-d711-49e6-9980-8a30441140a1 tempest-SnapshotsActionsTest-2018597254 None] Creating offline snapshot 7617340d-68d0-4855-a11e-47a1299569b1 of volume 86d24178-52ee-41bb-b265-9f04fc1ae1d5 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:02:24 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Volume volume-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d (7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d): created successfully
Jun 06 01:02:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056d6e13-ead3-4113-8709-961dad84d2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:02:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Flow 'volume_create_manager' (655b3210-0105-4cfd-ab1d-68a1ed97e907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:02:24 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e34ff3-8cd8-4e48-a12d-55006d46d76a]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c3425d59-d711-49e6-9980-8a30441140a1 tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:25 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f5c32c34-5ab4-435f-8253-112038bcfa45 tempest-VolumesAdminNegativeTest-660858556 None] Created volume successfully.
Jun 06 01:02:25 devstack sudo[87815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974
Jun 06 01:02:25 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:25 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c3425d59-d711-49e6-9980-8a30441140a1 tempest-SnapshotsActionsTest-2018597254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974" returned: 0 in 0.839s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:25 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-c3425d59-d711-49e6-9980-8a30441140a1 tempest-SnapshotsActionsTest-2018597254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:02:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c3425d59-d711-49e6-9980-8a30441140a1 tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:25 devstack sudo[87820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1 1G
Jun 06 01:02:25 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Acquiring lock "cinder-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Lock "cinder-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Acquiring lock "cinder-quobyte-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Lock "cinder-quobyte-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d" acquired by "delete_volume" :: waited 0.046s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:26 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[443b16fe-1925-40f6-8ed9-6842184908a8]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:26 devstack sudo[87824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d
Jun 06 01:02:26 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:27 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c3425d59-d711-49e6-9980-8a30441140a1 tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1 1G" returned: 0 in 1.330s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c3425d59-d711-49e6-9980-8a30441140a1 tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:27 devstack sudo[87830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1
Jun 06 01:02:27 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:27 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d" returned: 0 in 1.211s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:27 devstack sudo[87837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d
Jun 06 01:02:27 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:28 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c3425d59-d711-49e6-9980-8a30441140a1 tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1" returned: 0 in 1.205s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:28 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-c3425d59-d711-49e6-9980-8a30441140a1 tempest-SnapshotsActionsTest-2018597254 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1 is being set with open permissions: ugo+rw
Jun 06 01:02:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c3425d59-d711-49e6-9980-8a30441140a1 tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:28 devstack sudo[87859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1
Jun 06 01:02:28 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:28 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d" returned: 0 in 0.955s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:28 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Lock "cinder-quobyte-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d" released by "delete_volume" :: held 2.248s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:02:28 devstack cinder-volume[86581]: WARNING cinder.quota [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:02:28 devstack cinder-volume[86581]: WARNING cinder.quota [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:02:28 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Created reservations ['bca5ab83-e14b-49b9-863b-3049441e1abf', 'e69b5f1c-d043-4908-80c8-88583a1c75a5', 'dad0ad51-8ca6-4b64-a59d-cb98a1ed39f0', 'f53390c7-ac31-44d4-a6a5-e59c2a22bbc4'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:02:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:02:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:02:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:02:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:02:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:02:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:28 devstack sudo[87861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:02:28 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:29 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c3425d59-d711-49e6-9980-8a30441140a1 tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1" returned: 0 in 0.990s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c3425d59-d711-49e6-9980-8a30441140a1 tempest-SnapshotsActionsTest-2018597254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.558s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:02:29 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c3425d59-d711-49e6-9980-8a30441140a1 tempest-SnapshotsActionsTest-2018597254 None] Create snapshot completed successfully
Jun 06 01:02:29 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.903s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:29 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:02:29 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Deleted volume successfully.
Jun 06 01:02:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-975f6c04-3cea-4e01-8043-b61e5d5dc897 tempest-VolumesAdminNegativeTest-660858556 None] Lock "cinder-7f72a5f8-e0c2-4773-9ec6-12e2efd2d64d-delete_volume" released by "delete_volume" :: held 3.737s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:02:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Acquiring lock "cinder-7617340d-68d0-4855-a11e-47a1299569b1-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-7617340d-68d0-4855-a11e-47a1299569b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Acquiring lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Acquiring lock "cinder-quobyte-7617340d-68d0-4855-a11e-47a1299569b1" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-quobyte-7617340d-68d0-4855-a11e-47a1299569b1" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Deleting offline snapshot 7617340d-68d0-4855-a11e-47a1299569b1 of volume 86d24178-52ee-41bb-b265-9f04fc1ae1d5 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:02:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] snapshot_file for this snap is: volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:02:30 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8f7209-2b22-41f3-93c9-500510da02e0]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:30 devstack sudo[87871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1
Jun 06 01:02:30 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:31 devstack cinder-volume[86581]: WARNING py.warnings [req-7a02725b-fb6a-41ce-b7a9-0a0e58385d8b req-48ad550f-ad9a-4002-9b2a-fda79ee4a88c tempest-DeleteServersTestJSON-1287173930 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Jun 06 01:02:31 devstack cinder-volume[86581]:   .first()
Jun 06 01:02:31 devstack cinder-volume[86581]: 
Jun 06 01:02:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-7a02725b-fb6a-41ce-b7a9-0a0e58385d8b req-48ad550f-ad9a-4002-9b2a-fda79ee4a88c tempest-DeleteServersTestJSON-1287173930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:02:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-7a02725b-fb6a-41ce-b7a9-0a0e58385d8b req-48ad550f-ad9a-4002-9b2a-fda79ee4a88c tempest-DeleteServersTestJSON-1287173930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:02:31 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e2f61f-8528-47c0-bb6b-87e040b67362]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-7a02725b-fb6a-41ce-b7a9-0a0e58385d8b req-48ad550f-ad9a-4002-9b2a-fda79ee4a88c tempest-DeleteServersTestJSON-1287173930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:31 devstack sudo[87882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6
Jun 06 01:02:31 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:32 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1" returned: 0 in 1.450s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:02:32 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe067f0b-0bc8-4239-813b-f5e8441e6e4c]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:32 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-7a02725b-fb6a-41ce-b7a9-0a0e58385d8b req-48ad550f-ad9a-4002-9b2a-fda79ee4a88c tempest-DeleteServersTestJSON-1287173930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6" returned: 0 in 1.113s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-7a02725b-fb6a-41ce-b7a9-0a0e58385d8b req-48ad550f-ad9a-4002-9b2a-fda79ee4a88c tempest-DeleteServersTestJSON-1287173930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.130s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:02:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-7a02725b-fb6a-41ce-b7a9-0a0e58385d8b req-48ad550f-ad9a-4002-9b2a-fda79ee4a88c tempest-DeleteServersTestJSON-1287173930 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6dced05c-ef07-4fb2-8e5f-581305685077', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:02:32 devstack sudo[87967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974
Jun 06 01:02:32 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:32 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-7a02725b-fb6a-41ce-b7a9-0a0e58385d8b req-48ad550f-ad9a-4002-9b2a-fda79ee4a88c tempest-DeleteServersTestJSON-1287173930 None] attachment_update completed successfully.
Jun 06 01:02:32 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974" returned: 0 in 0.775s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:02:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:32 devstack sudo[88040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1
Jun 06 01:02:32 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:33 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1" returned: 0 in 0.776s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:33 devstack sudo[88365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1
Jun 06 01:02:33 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:34 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.7617340d-68d0-4855-a11e-47a1299569b1" returned: 0 in 0.630s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:34 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-quobyte-7617340d-68d0-4855-a11e-47a1299569b1" released by "_delete_snapshot" :: held 3.744s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:02:34 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" released by "delete_snapshot" :: held 3.783s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:02:34 devstack cinder-volume[86581]: WARNING cinder.quota [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:02:34 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Created reservations ['c3e688f4-4e10-4e7c-b9d6-a38bf54e1d0c', 'c7e2b6e7-2073-461b-8d3e-4e4c6de21d71', '0f65845e-5ccf-48cd-a400-ede5d10fc3ce', '93f611df-9925-4035-a397-b00e7fb7ccc9'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:02:34 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Delete snapshot completed successfully.
Jun 06 01:02:34 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-52c6296f-3b63-4ddc-aa43-70e9dc5c56c3 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-7617340d-68d0-4855-a11e-47a1299569b1-delete_snapshot" released by "delete_snapshot" :: held 3.916s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:02:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6815ce69-31d5-43df-81b4-3edf89254272 tempest-SnapshotsActionsTest-2018597254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:02:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6815ce69-31d5-43df-81b4-3edf89254272 tempest-SnapshotsActionsTest-2018597254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:02:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-6815ce69-31d5-43df-81b4-3edf89254272 tempest-SnapshotsActionsTest-2018597254 None] Creating offline snapshot c9a1aeea-a189-4e3e-99a2-049e86971039 of volume 86d24178-52ee-41bb-b265-9f04fc1ae1d5 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:02:35 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[61216b56-5b11-473c-8900-e4b25e903bb4]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6815ce69-31d5-43df-81b4-3edf89254272 tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:35 devstack sudo[88370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974
Jun 06 01:02:35 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:35 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6815ce69-31d5-43df-81b4-3edf89254272 tempest-SnapshotsActionsTest-2018597254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974" returned: 0 in 0.788s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-6815ce69-31d5-43df-81b4-3edf89254272 tempest-SnapshotsActionsTest-2018597254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:02:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6815ce69-31d5-43df-81b4-3edf89254272 tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:35 devstack sudo[88381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039 1G
Jun 06 01:02:35 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:36 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6815ce69-31d5-43df-81b4-3edf89254272 tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039 1G" returned: 0 in 0.815s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6815ce69-31d5-43df-81b4-3edf89254272 tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:36 devstack sudo[88387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039
Jun 06 01:02:36 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:37 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6815ce69-31d5-43df-81b4-3edf89254272 tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039" returned: 0 in 0.732s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:37 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-6815ce69-31d5-43df-81b4-3edf89254272 tempest-SnapshotsActionsTest-2018597254 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039 is being set with open permissions: ugo+rw
Jun 06 01:02:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6815ce69-31d5-43df-81b4-3edf89254272 tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:37 devstack sudo[88408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039
Jun 06 01:02:37 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:38 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6815ce69-31d5-43df-81b4-3edf89254272 tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039" returned: 0 in 0.626s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6815ce69-31d5-43df-81b4-3edf89254272 tempest-SnapshotsActionsTest-2018597254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.077s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:02:38 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-6815ce69-31d5-43df-81b4-3edf89254272 tempest-SnapshotsActionsTest-2018597254 None] Create snapshot completed successfully
Jun 06 01:02:38 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Acquiring lock "cinder-c9a1aeea-a189-4e3e-99a2-049e86971039-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:38 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-c9a1aeea-a189-4e3e-99a2-049e86971039-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:38 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Acquiring lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:38 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:38 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Acquiring lock "cinder-quobyte-c9a1aeea-a189-4e3e-99a2-049e86971039" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:38 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-quobyte-c9a1aeea-a189-4e3e-99a2-049e86971039" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Deleting offline snapshot c9a1aeea-a189-4e3e-99a2-049e86971039 of volume 86d24178-52ee-41bb-b265-9f04fc1ae1d5 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:02:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] snapshot_file for this snap is: volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:02:38 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89b7af0-3bf1-4fcb-9869-e253944ff29d]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:38 devstack sudo[88413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039
Jun 06 01:02:38 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:39 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039" returned: 0 in 1.039s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:02:39 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cc9a3a-27f6-4641-a6cd-503586c0bd61]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:39 devstack sudo[88457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974
Jun 06 01:02:39 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:40 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974" returned: 0 in 0.873s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:02:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:40 devstack sudo[88489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039
Jun 06 01:02:40 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:41 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039" returned: 0 in 0.813s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:41 devstack sudo[88497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039
Jun 06 01:02:41 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:41 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.c9a1aeea-a189-4e3e-99a2-049e86971039" returned: 0 in 0.598s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-quobyte-c9a1aeea-a189-4e3e-99a2-049e86971039" released by "_delete_snapshot" :: held 3.434s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:02:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" released by "delete_snapshot" :: held 3.465s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:02:41 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-7071ef94-13ab-4acc-b047-b45b9385a440 req-59823d51-2253-444d-8c5e-1d92ddf7e691 tempest-DeleteServersTestJSON-1287173930 None] Terminate volume connection completed successfully.
Jun 06 01:02:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-7071ef94-13ab-4acc-b047-b45b9385a440 req-59823d51-2253-444d-8c5e-1d92ddf7e691 tempest-DeleteServersTestJSON-1287173930 None] Deleting attachment 6dced05c-ef07-4fb2-8e5f-581305685077. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:02:42 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Created reservations ['4bd37dfa-c121-49c4-9cc8-0c39d2df618f', '2b88a0f0-6d7d-4b38-bf43-1b5f870e022a', 'de620ffa-6ec9-4317-9448-fcd8961cf62f', 'c1a93943-1a73-4750-a739-135acb95b7bc'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:02:42 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Delete snapshot completed successfully.
Jun 06 01:02:42 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-efa71667-5bce-4db1-977a-244f1c412b1e tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-c9a1aeea-a189-4e3e-99a2-049e86971039-delete_snapshot" released by "delete_snapshot" :: held 3.656s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:02:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d293c818-f847-479b-a9eb-700acd91a57a tempest-SnapshotsActionsTest-2018597254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:02:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d293c818-f847-479b-a9eb-700acd91a57a tempest-SnapshotsActionsTest-2018597254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:02:42 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d293c818-f847-479b-a9eb-700acd91a57a tempest-SnapshotsActionsTest-2018597254 None] Creating offline snapshot 50918836-f1de-488f-852c-9a80b40c72d9 of volume 86d24178-52ee-41bb-b265-9f04fc1ae1d5 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:02:43 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[67205033-9980-4bef-a181-71104d19b380]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d293c818-f847-479b-a9eb-700acd91a57a tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:43 devstack sudo[88503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974
Jun 06 01:02:43 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:43 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d293c818-f847-479b-a9eb-700acd91a57a tempest-SnapshotsActionsTest-2018597254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974" returned: 0 in 0.733s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d293c818-f847-479b-a9eb-700acd91a57a tempest-SnapshotsActionsTest-2018597254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:02:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d293c818-f847-479b-a9eb-700acd91a57a tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:43 devstack sudo[88508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9 1G
Jun 06 01:02:43 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:44 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d293c818-f847-479b-a9eb-700acd91a57a tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9 1G" returned: 0 in 0.864s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d293c818-f847-479b-a9eb-700acd91a57a tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:44 devstack sudo[88514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9
Jun 06 01:02:44 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:45 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d293c818-f847-479b-a9eb-700acd91a57a tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9" returned: 0 in 0.698s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:45 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-d293c818-f847-479b-a9eb-700acd91a57a tempest-SnapshotsActionsTest-2018597254 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9 is being set with open permissions: ugo+rw
Jun 06 01:02:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d293c818-f847-479b-a9eb-700acd91a57a tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:45 devstack sudo[88520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9
Jun 06 01:02:45 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:45 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] Acquiring lock "cinder-38bdb9c6-19b0-4422-b67b-e90aba035bf6-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:45 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] Lock "cinder-38bdb9c6-19b0-4422-b67b-e90aba035bf6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:45 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] Acquiring lock "cinder-quobyte-38bdb9c6-19b0-4422-b67b-e90aba035bf6" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:45 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] Lock "cinder-quobyte-38bdb9c6-19b0-4422-b67b-e90aba035bf6" acquired by "delete_volume" :: waited 0.027s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:45 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d293c818-f847-479b-a9eb-700acd91a57a tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9" returned: 0 in 0.623s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:45 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[497180e2-69b1-4662-b564-123c2ac30c08]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d293c818-f847-479b-a9eb-700acd91a57a tempest-SnapshotsActionsTest-2018597254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.025s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:02:46 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d293c818-f847-479b-a9eb-700acd91a57a tempest-SnapshotsActionsTest-2018597254 None] Create snapshot completed successfully
Jun 06 01:02:46 devstack sudo[88523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6
Jun 06 01:02:46 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Acquiring lock "cinder-50918836-f1de-488f-852c-9a80b40c72d9-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-50918836-f1de-488f-852c-9a80b40c72d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Acquiring lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Acquiring lock "cinder-quobyte-50918836-f1de-488f-852c-9a80b40c72d9" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-quobyte-50918836-f1de-488f-852c-9a80b40c72d9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Deleting offline snapshot 50918836-f1de-488f-852c-9a80b40c72d9 of volume 86d24178-52ee-41bb-b265-9f04fc1ae1d5 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:02:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] snapshot_file for this snap is: volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:02:46 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a70d28-facc-4b0e-8e9b-9909defe3eee]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:46 devstack sudo[88526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9
Jun 06 01:02:46 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:46 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6" returned: 0 in 0.835s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:46 devstack sudo[88532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6
Jun 06 01:02:46 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:47 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9" returned: 0 in 0.758s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:02:47 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc44ab7a-5c84-419f-8953-161648c0d962]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:47 devstack sudo[88537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974
Jun 06 01:02:47 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:47 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38bdb9c6-19b0-4422-b67b-e90aba035bf6" returned: 0 in 0.666s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:47 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] Lock "cinder-quobyte-38bdb9c6-19b0-4422-b67b-e90aba035bf6" released by "delete_volume" :: held 1.552s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:02:47 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] Created reservations ['65101555-768f-4aa9-92bc-c35ef3cfd2da', 'd5e56b78-d399-4a55-929c-33ac5656c06f', 'b5e6baf9-8b51-40e2-a26a-44cbeab77ba0', '664dc94e-b9fd-499e-a63a-92f3dd59d595'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:02:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:02:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:02:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:02:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:02:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:02:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:47 devstack sudo[88540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:02:47 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:47 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974" returned: 0 in 0.788s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:02:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:47 devstack sudo[88546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9
Jun 06 01:02:47 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:48 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.772s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:48 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:02:48 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] Deleted volume successfully.
Jun 06 01:02:48 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-01750798-aac3-4669-8858-d87653594f35 tempest-DeleteServersTestJSON-1287173930 None] Lock "cinder-38bdb9c6-19b0-4422-b67b-e90aba035bf6-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:02:48 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9" returned: 0 in 0.807s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:48 devstack sudo[88553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9
Jun 06 01:02:48 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:49 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.50918836-f1de-488f-852c-9a80b40c72d9" returned: 0 in 0.662s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-quobyte-50918836-f1de-488f-852c-9a80b40c72d9" released by "_delete_snapshot" :: held 3.119s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:02:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" released by "delete_snapshot" :: held 3.141s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:02:49 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Created reservations ['8d39eb8d-0f66-46eb-b6b2-a450862ae70b', '148dc476-d2d1-419f-84c3-58b327de0f30', '09d85525-e706-4eb0-a1d4-db1010ae4fbf', 'bfbc82c6-253f-4b61-af03-2822785755d6'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:02:49 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Delete snapshot completed successfully.
Jun 06 01:02:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-565f3db8-5959-4349-ba4a-c042a45f3761 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-50918836-f1de-488f-852c-9a80b40c72d9-delete_snapshot" released by "delete_snapshot" :: held 3.287s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:02:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b17084ce-a80b-4515-b5f6-e7cb27f2057f tempest-SnapshotsActionsTest-2018597254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:02:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b17084ce-a80b-4515-b5f6-e7cb27f2057f tempest-SnapshotsActionsTest-2018597254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:02:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-b17084ce-a80b-4515-b5f6-e7cb27f2057f tempest-SnapshotsActionsTest-2018597254 None] Creating offline snapshot 3c26e4c2-dd66-4890-9fbc-47cf6d366b5b of volume 86d24178-52ee-41bb-b265-9f04fc1ae1d5 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:02:50 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[0929fc31-7b18-4036-8bd0-e3eda3a8e107]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b17084ce-a80b-4515-b5f6-e7cb27f2057f tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:50 devstack sudo[88558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974
Jun 06 01:02:50 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:50 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b17084ce-a80b-4515-b5f6-e7cb27f2057f tempest-SnapshotsActionsTest-2018597254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974" returned: 0 in 0.770s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-b17084ce-a80b-4515-b5f6-e7cb27f2057f tempest-SnapshotsActionsTest-2018597254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:02:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b17084ce-a80b-4515-b5f6-e7cb27f2057f tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:50 devstack sudo[88563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b 1G
Jun 06 01:02:50 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:51 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b17084ce-a80b-4515-b5f6-e7cb27f2057f tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b 1G" returned: 0 in 0.891s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b17084ce-a80b-4515-b5f6-e7cb27f2057f tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:51 devstack sudo[88568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b
Jun 06 01:02:51 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:52 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b17084ce-a80b-4515-b5f6-e7cb27f2057f tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b" returned: 0 in 0.719s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:52 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-b17084ce-a80b-4515-b5f6-e7cb27f2057f tempest-SnapshotsActionsTest-2018597254 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b is being set with open permissions: ugo+rw
Jun 06 01:02:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b17084ce-a80b-4515-b5f6-e7cb27f2057f tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:52 devstack sudo[88575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b
Jun 06 01:02:52 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:53 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b17084ce-a80b-4515-b5f6-e7cb27f2057f tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b" returned: 0 in 0.623s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b17084ce-a80b-4515-b5f6-e7cb27f2057f tempest-SnapshotsActionsTest-2018597254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.109s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:02:53 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b17084ce-a80b-4515-b5f6-e7cb27f2057f tempest-SnapshotsActionsTest-2018597254 None] Create snapshot completed successfully
Jun 06 01:02:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Acquiring lock "cinder-3c26e4c2-dd66-4890-9fbc-47cf6d366b5b-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-3c26e4c2-dd66-4890-9fbc-47cf6d366b5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Acquiring lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Acquiring lock "cinder-quobyte-3c26e4c2-dd66-4890-9fbc-47cf6d366b5b" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-quobyte-3c26e4c2-dd66-4890-9fbc-47cf6d366b5b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Deleting offline snapshot 3c26e4c2-dd66-4890-9fbc-47cf6d366b5b of volume 86d24178-52ee-41bb-b265-9f04fc1ae1d5 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:02:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] snapshot_file for this snap is: volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:02:54 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba35d151-3e8e-4b83-b8a1-928b3c82df5b]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:54 devstack sudo[88581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b
Jun 06 01:02:54 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:55 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b" returned: 0 in 0.750s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:02:55 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b0d413-eace-40e4-bb13-67bee6ab9684]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:55 devstack sudo[88586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974
Jun 06 01:02:55 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:56 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974" returned: 0 in 0.800s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:02:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:56 devstack sudo[88593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b
Jun 06 01:02:56 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:56 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b" returned: 0 in 0.785s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:56 devstack sudo[88598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b
Jun 06 01:02:56 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:57 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root
Jun 06 01:02:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.3c26e4c2-dd66-4890-9fbc-47cf6d366b5b" returned: 0 in 0.684s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:02:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-quobyte-3c26e4c2-dd66-4890-9fbc-47cf6d366b5b" released by "_delete_snapshot" :: held 3.143s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:02:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" released by "delete_snapshot" :: held 3.169s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:02:57 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Created reservations ['dffbba4e-f388-4e34-baed-8670421a77f1', '3517e1d9-27f8-4e1b-a38e-49e84eae261b', '43ca28f9-d545-4877-ac9f-42a14ab52136', 'a8c5586d-d3a3-435b-adf9-1ced58be5536'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:02:57 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Delete snapshot completed successfully.
Jun 06 01:02:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4eb10e5b-54ee-4b8b-b14d-f01463abc592 tempest-SnapshotsActionsTest-1195268298 None] Lock "cinder-3c26e4c2-dd66-4890-9fbc-47cf6d366b5b-delete_snapshot" released by "delete_snapshot" :: held 3.336s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:02:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] Acquiring lock "cinder-5dc388a8-7e03-4673-9a92-69d0ebd81974-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] Lock "cinder-5dc388a8-7e03-4673-9a92-69d0ebd81974-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] Acquiring lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] Lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] Acquiring lock "cinder-quobyte-5dc388a8-7e03-4673-9a92-69d0ebd81974" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:02:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] Lock "cinder-quobyte-5dc388a8-7e03-4673-9a92-69d0ebd81974" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:02:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] Deleting offline snapshot 5dc388a8-7e03-4673-9a92-69d0ebd81974 of volume 86d24178-52ee-41bb-b265-9f04fc1ae1d5 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:02:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] snapshot_file for this snap is: volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:02:59 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[da31e89f-7fd4-4cc1-8ac3-477d3fe45ba2]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:02:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:59 devstack sudo[88601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974
Jun 06 01:02:59 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:02:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:02:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:02:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:02:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:02:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:02:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:02:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:02:59 devstack sudo[88603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:02:59 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:00 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974" returned: 0 in 0.922s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:03:00 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1504a7-d0ba-405c-95ea-905f210f5567]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:03:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:00 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.810s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:03:00 devstack sudo[88610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5
Jun 06 01:03:00 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:00 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5" returned: 0 in 0.788s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:00 devstack sudo[88617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974
Jun 06 01:03:00 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:01 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974" returned: 0 in 1.025s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:01 devstack sudo[88660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974
Jun 06 01:03:01 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:02 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5.5dc388a8-7e03-4673-9a92-69d0ebd81974" returned: 0 in 0.748s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:02 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] Lock "cinder-quobyte-5dc388a8-7e03-4673-9a92-69d0ebd81974" released by "_delete_snapshot" :: held 3.642s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:03:02 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] Lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" released by "delete_snapshot" :: held 3.675s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:03:02 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] Created reservations ['f35fef7d-4176-46f8-b16e-66a3800eeb67', 'a8b264dc-d304-436d-a745-21db12d3eccd', '4588e337-24d6-46e4-b70e-72c90bb9b864', '0270ef46-7d35-4d6b-8b0a-83efa88d7973'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:03:02 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] Delete snapshot completed successfully.
Jun 06 01:03:02 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56b071f2-d2c9-4527-a542-ef3590c03d1b tempest-SnapshotsActionsTest-2018597254 None] Lock "cinder-5dc388a8-7e03-4673-9a92-69d0ebd81974-delete_snapshot" released by "delete_snapshot" :: held 3.831s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:03:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] Acquiring lock "cinder-86d24178-52ee-41bb-b265-9f04fc1ae1d5-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:03:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] Lock "cinder-86d24178-52ee-41bb-b265-9f04fc1ae1d5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:03:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] Acquiring lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:03:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] Lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" acquired by "delete_volume" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:03:03 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[107ddbfa-2b47-4b56-925e-422a89ea446a]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:03:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:03 devstack sudo[88664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5
Jun 06 01:03:03 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:04 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5" returned: 0 in 0.766s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:04 devstack sudo[88669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5
Jun 06 01:03:04 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:05 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-86d24178-52ee-41bb-b265-9f04fc1ae1d5" returned: 0 in 0.774s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] Lock "cinder-quobyte-86d24178-52ee-41bb-b265-9f04fc1ae1d5" released by "delete_volume" :: held 1.621s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:03:05 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] Created reservations ['d24392ab-a3c2-4b6e-a635-89ffc3b8f3e2', '7a267302-f1c9-4c9b-8361-d83358397ef9', '3d50e36b-0041-4a12-a408-95fd38cbe222', '09ae6564-f428-4742-9ab8-35b2b49b9aa1'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:03:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:03:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:03:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:03:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:03:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:03:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:05 devstack sudo[88672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:03:05 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:06 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.924s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:06 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:03:06 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] Deleted volume successfully.
Jun 06 01:03:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f886a52f-940b-4bf6-b97b-c7b02693122d tempest-SnapshotsActionsTest-2018597254 None] Lock "cinder-86d24178-52ee-41bb-b265-9f04fc1ae1d5-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:03:15 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=59,cinder:UPDATE=67,cinder:INSERT=17,cinder:DELETE=2 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:03:16 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=71,cinder:UPDATE=69,cinder:DELETE=9,cinder:INSERT=19 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:03:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-2428452a-d2fb-4213-82cd-51096f9ae1e0 req-a9303cc7-e87e-45e0-9e41-9684a8ca2688 tempest-TaggedAttachmentsTest-783823475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:03:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-2428452a-d2fb-4213-82cd-51096f9ae1e0 req-a9303cc7-e87e-45e0-9e41-9684a8ca2688 tempest-TaggedAttachmentsTest-783823475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:03:17 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b93a38-0563-4510-9487-c5aaf86e0382]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:03:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-2428452a-d2fb-4213-82cd-51096f9ae1e0 req-a9303cc7-e87e-45e0-9e41-9684a8ca2688 tempest-TaggedAttachmentsTest-783823475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6610b264-4e10-48b7-97ac-a25831acae34 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:17 devstack sudo[88783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6610b264-4e10-48b7-97ac-a25831acae34
Jun 06 01:03:17 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:18 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-2428452a-d2fb-4213-82cd-51096f9ae1e0 req-a9303cc7-e87e-45e0-9e41-9684a8ca2688 tempest-TaggedAttachmentsTest-783823475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6610b264-4e10-48b7-97ac-a25831acae34" returned: 0 in 1.078s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-2428452a-d2fb-4213-82cd-51096f9ae1e0 req-a9303cc7-e87e-45e0-9e41-9684a8ca2688 tempest-TaggedAttachmentsTest-783823475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.102s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:03:18 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-2428452a-d2fb-4213-82cd-51096f9ae1e0 req-a9303cc7-e87e-45e0-9e41-9684a8ca2688 tempest-TaggedAttachmentsTest-783823475 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-6610b264-4e10-48b7-97ac-a25831acae34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a24da86-f45e-4378-98c4-8a4a341beae3', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:03:18 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-2428452a-d2fb-4213-82cd-51096f9ae1e0 req-a9303cc7-e87e-45e0-9e41-9684a8ca2688 tempest-TaggedAttachmentsTest-783823475 None] attachment_update completed successfully.
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Flow 'volume_create_manager' (bc642f6e-ff0d-4122-b525-314083b4aa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50e1a9c-0776-4891-b7c6-80e3e47cc2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50e1a9c-0776-4891-b7c6-80e3e47cc2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1021685112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1967721a-c2b2-4787-8d4e-d7e0ea914fa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908dd9933f814d778b8a65d096debfda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:03:23Z,use_quota=True,user_id='36357cd17be84b2a8e276d8b6d519145',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f615ca8-cfef-4428-8699-6ae3ed7781b1),volume_type_id=0f615ca8-cfef-4428-8699-6ae3ed7781b1)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c38188e-560a-40a0-9db2-ddcd4aff2a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c38188e-560a-40a0-9db2-ddcd4aff2a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8896d2f0-91d3-4536-ad54-212e7003bb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8896d2f0-91d3-4536-ad54-212e7003bb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1967721a-c2b2-4787-8d4e-d7e0ea914fa6', 'volume_name': 'volume-1967721a-c2b2-4787-8d4e-d7e0ea914fa6', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d11bd7-0a1f-4996-96bd-ed526c40ebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d11bd7-0a1f-4996-96bd-ed526c40ebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073c89a1-4d2e-4f0a-a74e-6f05fc968ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:23 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Volume 1967721a-c2b2-4787-8d4e-d7e0ea914fa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1967721a-c2b2-4787-8d4e-d7e0ea914fa6', 'volume_size': 1}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1021685112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1967721a-c2b2-4787-8d4e-d7e0ea914fa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908dd9933f814d778b8a65d096debfda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:03:23Z,use_quota=True,user_id='36357cd17be84b2a8e276d8b6d519145',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f615ca8-cfef-4428-8699-6ae3ed7781b1),volume_type_id=0f615ca8-cfef-4428-8699-6ae3ed7781b1)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Creating volume 1967721a-c2b2-4787-8d4e-d7e0ea914fa6 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:03:23 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:03:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1967721a-c2b2-4787-8d4e-d7e0ea914fa6 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:23 devstack sudo[89265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1967721a-c2b2-4787-8d4e-d7e0ea914fa6 1073741824
Jun 06 01:03:23 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:24 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1967721a-c2b2-4787-8d4e-d7e0ea914fa6 1073741824" returned: 0 in 1.094s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1967721a-c2b2-4787-8d4e-d7e0ea914fa6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:24 devstack sudo[89278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1967721a-c2b2-4787-8d4e-d7e0ea914fa6
Jun 06 01:03:24 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:25 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1967721a-c2b2-4787-8d4e-d7e0ea914fa6" returned: 0 in 0.660s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:25 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:03:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:03:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073c89a1-4d2e-4f0a-a74e-6f05fc968ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1967721a-c2b2-4787-8d4e-d7e0ea914fa6', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d6919d-8814-4631-92e8-7bbf57e4ba1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:25 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Volume volume-1967721a-c2b2-4787-8d4e-d7e0ea914fa6 (1967721a-c2b2-4787-8d4e-d7e0ea914fa6): created successfully
Jun 06 01:03:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d6919d-8814-4631-92e8-7bbf57e4ba1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Flow 'volume_create_manager' (bc642f6e-ff0d-4122-b525-314083b4aa3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:03:25 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-8c025806-a517-42d2-b9c3-a5a3f9f47394 tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Created volume successfully.
Jun 06 01:03:25 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-fc2e118a-694e-4f5d-bead-248f49750924 req-ff290808-744e-46dd-b209-7a09c680e548 tempest-TaggedAttachmentsTest-783823475 None] Terminate volume connection completed successfully.
Jun 06 01:03:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-fc2e118a-694e-4f5d-bead-248f49750924 req-ff290808-744e-46dd-b209-7a09c680e548 tempest-TaggedAttachmentsTest-783823475 None] Deleting attachment 5a24da86-f45e-4378-98c4-8a4a341beae3. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:03:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-80a3d1dd-af65-42c6-b672-9c7532950bda tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:03:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-80a3d1dd-af65-42c6-b672-9c7532950bda tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:03:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-80a3d1dd-af65-42c6-b672-9c7532950bda tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:03:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-80a3d1dd-af65-42c6-b672-9c7532950bda tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:03:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-80a3d1dd-af65-42c6-b672-9c7532950bda tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:03:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-80a3d1dd-af65-42c6-b672-9c7532950bda tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:27 devstack sudo[89379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:03:27 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-80a3d1dd-af65-42c6-b672-9c7532950bda tempest-VolumeRetypeWithoutMigrationTest-806692369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.074s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:28 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:28 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-80a3d1dd-af65-42c6-b672-9c7532950bda tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:03:28 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-80a3d1dd-af65-42c6-b672-9c7532950bda tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Retype volume completed successfully.
Jun 06 01:03:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Acquiring lock "cinder-1967721a-c2b2-4787-8d4e-d7e0ea914fa6-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:03:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Lock "cinder-1967721a-c2b2-4787-8d4e-d7e0ea914fa6-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:03:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Acquiring lock "cinder-quobyte-1967721a-c2b2-4787-8d4e-d7e0ea914fa6" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:03:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Lock "cinder-quobyte-1967721a-c2b2-4787-8d4e-d7e0ea914fa6" acquired by "delete_volume" :: waited 0.041s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:03:29 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[82655400-73d8-4b5e-b80a-ad671e5ea733]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:03:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1967721a-c2b2-4787-8d4e-d7e0ea914fa6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:29 devstack sudo[89410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1967721a-c2b2-4787-8d4e-d7e0ea914fa6
Jun 06 01:03:29 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:31 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1967721a-c2b2-4787-8d4e-d7e0ea914fa6" returned: 0 in 1.315s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1967721a-c2b2-4787-8d4e-d7e0ea914fa6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:31 devstack sudo[89417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1967721a-c2b2-4787-8d4e-d7e0ea914fa6
Jun 06 01:03:31 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:32 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1967721a-c2b2-4787-8d4e-d7e0ea914fa6" returned: 0 in 1.403s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:32 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Lock "cinder-quobyte-1967721a-c2b2-4787-8d4e-d7e0ea914fa6" released by "delete_volume" :: held 2.858s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:03:32 devstack cinder-volume[86581]: WARNING cinder.quota [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:03:32 devstack cinder-volume[86581]: WARNING cinder.quota [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:03:32 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Created reservations ['eea9dab6-dbd7-42f7-818c-3381ac734797', '7729b926-583a-4be7-8f9c-00b982bbae78', 'a88008a2-99ec-4283-b0ef-0c7617c34f77', '096c6cb6-736c-46c2-9a16-b415e1cc5e1b'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:03:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:03:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:03:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:03:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:03:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:03:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:33 devstack sudo[89438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:03:33 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:34 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.599s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:34 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:03:34 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Deleted volume successfully.
Jun 06 01:03:34 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-fffcda35-a5ec-42ea-9855-886dec3f4e9b tempest-VolumeRetypeWithoutMigrationTest-806692369 None] Lock "cinder-1967721a-c2b2-4787-8d4e-d7e0ea914fa6-delete_volume" released by "delete_volume" :: held 5.248s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:03:42 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=24,cinder:UPDATE=16,cinder:INSERT=2 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:03:44 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=17,cinder:UPDATE=18,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:03:50 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] Acquiring lock "cinder-6610b264-4e10-48b7-97ac-a25831acae34-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:03:50 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] Lock "cinder-6610b264-4e10-48b7-97ac-a25831acae34-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:03:50 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] Acquiring lock "cinder-quobyte-6610b264-4e10-48b7-97ac-a25831acae34" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:03:50 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] Lock "cinder-quobyte-6610b264-4e10-48b7-97ac-a25831acae34" acquired by "delete_volume" :: waited 0.025s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:03:50 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[751b7f2b-6988-46ec-9745-6c4aa7f57bee]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:03:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6610b264-4e10-48b7-97ac-a25831acae34 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:50 devstack sudo[89657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6610b264-4e10-48b7-97ac-a25831acae34
Jun 06 01:03:50 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:51 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6610b264-4e10-48b7-97ac-a25831acae34" returned: 0 in 0.811s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6610b264-4e10-48b7-97ac-a25831acae34 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:51 devstack sudo[89662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6610b264-4e10-48b7-97ac-a25831acae34
Jun 06 01:03:51 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:51 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6610b264-4e10-48b7-97ac-a25831acae34" returned: 0 in 0.677s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] Lock "cinder-quobyte-6610b264-4e10-48b7-97ac-a25831acae34" released by "delete_volume" :: held 1.536s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:03:52 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] Created reservations ['9544eaab-073f-4e9e-ad1e-b2c783728e09', '3441fc08-d912-4781-bf8e-2a02e2c12659', 'f6b08eba-f5c9-4877-ae58-d32463562a65', '0c9e67ce-6698-424b-8b13-4ab2d438b1d0'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:03:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:03:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:03:52 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:03:52 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:03:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:03:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:52 devstack sudo[89666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:03:52 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:52 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.648s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:52 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:03:52 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] Deleted volume successfully.
Jun 06 01:03:52 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-61111404-178d-4777-94e7-b15f28eb18c7 tempest-TaggedAttachmentsTest-783823475 None] Lock "cinder-6610b264-4e10-48b7-97ac-a25831acae34-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Flow 'volume_create_manager' (37ebbc6e-cc46-4d53-ab07-ec51c04b6550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f7da2b-e61b-4fd6-af0c-1c8b0068a88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f7da2b-e61b-4fd6-af0c-1c8b0068a88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-932875736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72805362-de69-491c-978f-8b577745eba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93a88985e174886a126f355f7d56cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:03:54Z,use_quota=True,user_id='8d120e1823c741e49b4f18be11fef7dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a02956-bbf4-4fc2-9720-3bd3e1f950a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a02956-bbf4-4fc2-9720-3bd3e1f950a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8b291a-ce10-4c83-b3e1-9f4edc1738a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8b291a-ce10-4c83-b3e1-9f4edc1738a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72805362-de69-491c-978f-8b577745eba5', 'volume_name': 'volume-72805362-de69-491c-978f-8b577745eba5', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de357c8-ed14-4583-87b8-45d4c38ebfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de357c8-ed14-4583-87b8-45d4c38ebfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbbba51-2fe0-4e59-ae86-5f85cd3365c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:54 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Volume 72805362-de69-491c-978f-8b577745eba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72805362-de69-491c-978f-8b577745eba5', 'volume_size': 1}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-932875736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72805362-de69-491c-978f-8b577745eba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93a88985e174886a126f355f7d56cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:03:54Z,use_quota=True,user_id='8d120e1823c741e49b4f18be11fef7dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Creating volume 72805362-de69-491c-978f-8b577745eba5 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:03:54 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-72805362-de69-491c-978f-8b577745eba5 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:54 devstack sudo[89672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-72805362-de69-491c-978f-8b577745eba5 1073741824
Jun 06 01:03:54 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Flow 'volume_create_manager' (28e495d7-54fb-4edd-8a9e-700e20f1cd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609f73dd-2811-40c9-a6a0-1d68e275ce99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609f73dd-2811-40c9-a6a0-1d68e275ce99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-982730223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bb6859f-4155-494b-bb80-a9ead3ab6696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94342b432fc646e39a1a8d6e718a7383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:03:54Z,use_quota=True,user_id='846378fbea484da9947e2bfa7f583392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0f6d88-5b78-4618-83e8-a093c9a5e711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0f6d88-5b78-4618-83e8-a093c9a5e711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806c395c-8d8c-4f39-a3e1-80116d69e401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806c395c-8d8c-4f39-a3e1-80116d69e401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bb6859f-4155-494b-bb80-a9ead3ab6696', 'volume_name': 'volume-6bb6859f-4155-494b-bb80-a9ead3ab6696', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ed3383-3c82-47db-a111-19bbb34fe3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ed3383-3c82-47db-a111-19bbb34fe3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c163445c-c4cf-49e5-9e5f-5e6870179092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:54 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Volume 6bb6859f-4155-494b-bb80-a9ead3ab6696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bb6859f-4155-494b-bb80-a9ead3ab6696', 'volume_size': 1}
Jun 06 01:03:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:03:55 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-72805362-de69-491c-978f-8b577745eba5 1073741824" returned: 0 in 0.821s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-72805362-de69-491c-978f-8b577745eba5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:55 devstack sudo[89678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-72805362-de69-491c-978f-8b577745eba5
Jun 06 01:03:55 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:56 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-72805362-de69-491c-978f-8b577745eba5" returned: 0 in 0.596s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:03:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:03:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.353s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:03:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-982730223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bb6859f-4155-494b-bb80-a9ead3ab6696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94342b432fc646e39a1a8d6e718a7383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:03:54Z,use_quota=True,user_id='846378fbea484da9947e2bfa7f583392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:03:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Creating volume 6bb6859f-4155-494b-bb80-a9ead3ab6696 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:03:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:03:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:03:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:03:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:03:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:03:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:03:56 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:03:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:56 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 1073741824
Jun 06 01:03:56 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbbba51-2fe0-4e59-ae86-5f85cd3365c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72805362-de69-491c-978f-8b577745eba5', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b50d31-7334-4b39-8abd-328112f422c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:56 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Volume volume-72805362-de69-491c-978f-8b577745eba5 (72805362-de69-491c-978f-8b577745eba5): created successfully
Jun 06 01:03:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b50d31-7334-4b39-8abd-328112f422c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Flow 'volume_create_manager' (37ebbc6e-cc46-4d53-ab07-ec51c04b6550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:03:56 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-cfef9659-ac58-4767-9c33-947d5bc01558 tempest-ServersNegativeTestJSON-112303491 None] Created volume successfully.
Jun 06 01:03:57 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 1073741824" returned: 0 in 1.034s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:57 devstack sudo[89691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696
Jun 06 01:03:57 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Flow 'volume_create_manager' (717329e1-7012-4850-822e-c28503a7858a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c06cbd8-481e-4f73-9fbf-cd56c74be384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c06cbd8-481e-4f73-9fbf-cd56c74be384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-831914967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56599a66-81c2-4376-95be-884d0d6916cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bef206b749b4fd0a76bf7b2ed1f7408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:03:57Z,use_quota=True,user_id='c655ca60369140a0a9db3adb37fcbd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae03f2f-4ad8-4077-9b69-369ff5e35fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae03f2f-4ad8-4077-9b69-369ff5e35fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b5b0c2-aada-4279-a360-bc039ddd2fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b5b0c2-aada-4279-a360-bc039ddd2fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56599a66-81c2-4376-95be-884d0d6916cd', 'volume_name': 'volume-56599a66-81c2-4376-95be-884d0d6916cd', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c24d55-5227-45f0-bc1d-82badac0cb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c24d55-5227-45f0-bc1d-82badac0cb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d3f647-72b4-4964-9ef7-6a591ee43bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:57 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Volume 56599a66-81c2-4376-95be-884d0d6916cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56599a66-81c2-4376-95be-884d0d6916cd', 'volume_size': 1}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:03:57 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696" returned: 0 in 0.732s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.517s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-831914967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56599a66-81c2-4376-95be-884d0d6916cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bef206b749b4fd0a76bf7b2ed1f7408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:03:57Z,use_quota=True,user_id='c655ca60369140a0a9db3adb37fcbd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Creating volume 56599a66-81c2-4376-95be-884d0d6916cd {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:03:57 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c163445c-c4cf-49e5-9e5f-5e6870179092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bb6859f-4155-494b-bb80-a9ead3ab6696', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbb58aa-f7b1-4f30-96d4-057b08c79859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:57 devstack sudo[89695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd 1073741824
Jun 06 01:03:57 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:57 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Volume volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 (6bb6859f-4155-494b-bb80-a9ead3ab6696): created successfully
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbb58aa-f7b1-4f30-96d4-057b08c79859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Flow 'volume_create_manager' (28e495d7-54fb-4edd-8a9e-700e20f1cd63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:03:57 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-213ea23e-9aee-4b90-b4c7-96bd4aa6fcea tempest-VolumesActionsTest-738214371 None] Created volume successfully.
Jun 06 01:03:58 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:03:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Flow 'volume_create_manager' (a167638b-52e9-43f0-a3ed-5ded7912b104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:03:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1c4780-635a-4b10-9351-18aba6e309ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1c4780-635a-4b10-9351-18aba6e309ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2112015073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9353439-ed08-469d-8df1-7edbba5ba6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93a88985e174886a126f355f7d56cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:03:58Z,use_quota=True,user_id='8d120e1823c741e49b4f18be11fef7dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502b9109-7e5b-4070-bb95-da5a666bdf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502b9109-7e5b-4070-bb95-da5a666bdf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c76f8d-1da1-490c-ab9a-f0623ef3ba17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c76f8d-1da1-490c-ab9a-f0623ef3ba17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9353439-ed08-469d-8df1-7edbba5ba6f6', 'volume_name': 'volume-a9353439-ed08-469d-8df1-7edbba5ba6f6', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4f5c6f-385a-4f17-8999-8baa30c018e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4f5c6f-385a-4f17-8999-8baa30c018e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44875689-b5e3-493e-b048-ed4c72b0c568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:58 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Volume a9353439-ed08-469d-8df1-7edbba5ba6f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9353439-ed08-469d-8df1-7edbba5ba6f6', 'volume_size': 1}
Jun 06 01:03:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:03:58 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd 1073741824" returned: 0 in 1.074s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:58 devstack sudo[89703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd
Jun 06 01:03:58 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:59 devstack sudo[89705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:03:59 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:59 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd" returned: 0 in 0.819s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.302s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2112015073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9353439-ed08-469d-8df1-7edbba5ba6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93a88985e174886a126f355f7d56cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:03:58Z,use_quota=True,user_id='8d120e1823c741e49b4f18be11fef7dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Creating volume a9353439-ed08-469d-8df1-7edbba5ba6f6 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:03:59 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a9353439-ed08-469d-8df1-7edbba5ba6f6 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d3f647-72b4-4964-9ef7-6a591ee43bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56599a66-81c2-4376-95be-884d0d6916cd', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec80b4e-998d-4328-a574-bf939d0be937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:03:59 devstack sudo[89708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a9353439-ed08-469d-8df1-7edbba5ba6f6 1073741824
Jun 06 01:03:59 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:03:59 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Volume volume-56599a66-81c2-4376-95be-884d0d6916cd (56599a66-81c2-4376-95be-884d0d6916cd): created successfully
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec80b4e-998d-4328-a574-bf939d0be937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:03:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Flow 'volume_create_manager' (717329e1-7012-4850-822e-c28503a7858a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:03:59 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-03a7273b-2e4b-4ad9-a9ea-875cae9d1867 tempest-ServerActionsTestOtherA-1623255764 None] Created volume successfully.
Jun 06 01:04:00 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.892s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:04:01 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a9353439-ed08-469d-8df1-7edbba5ba6f6 1073741824" returned: 0 in 1.190s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a9353439-ed08-469d-8df1-7edbba5ba6f6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:01 devstack sudo[89721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a9353439-ed08-469d-8df1-7edbba5ba6f6
Jun 06 01:04:01 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:02 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a9353439-ed08-469d-8df1-7edbba5ba6f6" returned: 0 in 0.971s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:02 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] <== create_volume: return (2222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:04:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.225s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:04:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44875689-b5e3-493e-b048-ed4c72b0c568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9353439-ed08-469d-8df1-7edbba5ba6f6', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:04:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d388e8-1df6-4b41-ab3b-4f8dce6a1b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:04:02 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Volume volume-a9353439-ed08-469d-8df1-7edbba5ba6f6 (a9353439-ed08-469d-8df1-7edbba5ba6f6): created successfully
Jun 06 01:04:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d388e8-1df6-4b41-ab3b-4f8dce6a1b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:04:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Flow 'volume_create_manager' (a167638b-52e9-43f0-a3ed-5ded7912b104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:04:02 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-3667a894-b5a1-4214-9d30-68bb62f28bd2 tempest-ServersNegativeTestJSON-112303491 None] Created volume successfully.
Jun 06 01:04:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] Acquiring lock "cinder-a9353439-ed08-469d-8df1-7edbba5ba6f6-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:04:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] Lock "cinder-a9353439-ed08-469d-8df1-7edbba5ba6f6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:04:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] Acquiring lock "cinder-quobyte-a9353439-ed08-469d-8df1-7edbba5ba6f6" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:04:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] Lock "cinder-quobyte-a9353439-ed08-469d-8df1-7edbba5ba6f6" acquired by "delete_volume" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:04:03 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d366b9c-a5c0-4d2b-bf80-cd848e5321e2]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:04:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a9353439-ed08-469d-8df1-7edbba5ba6f6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:03 devstack sudo[89769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a9353439-ed08-469d-8df1-7edbba5ba6f6
Jun 06 01:04:03 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:04 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a9353439-ed08-469d-8df1-7edbba5ba6f6" returned: 0 in 0.704s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a9353439-ed08-469d-8df1-7edbba5ba6f6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:04 devstack sudo[89774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a9353439-ed08-469d-8df1-7edbba5ba6f6
Jun 06 01:04:04 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:04 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a9353439-ed08-469d-8df1-7edbba5ba6f6" returned: 0 in 0.602s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] Lock "cinder-quobyte-a9353439-ed08-469d-8df1-7edbba5ba6f6" released by "delete_volume" :: held 1.346s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:04:04 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] Created reservations ['3190163e-2fca-4097-acaa-e4f146565408', 'f81bf782-c420-4c1b-9498-f83d62574f3a', 'cdccb064-64c9-4ab6-9428-4f1621d1eece', 'a08dca75-4aba-4973-b8a7-25f56e6f60e7'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:04:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:04:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:04:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:04:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:04:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:04:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:04 devstack sudo[89777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:04:04 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] Acquiring lock "cinder-72805362-de69-491c-978f-8b577745eba5-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:04:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] Lock "cinder-72805362-de69-491c-978f-8b577745eba5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:04:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] Acquiring lock "cinder-quobyte-72805362-de69-491c-978f-8b577745eba5" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:04:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] Lock "cinder-quobyte-72805362-de69-491c-978f-8b577745eba5" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:04:05 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[baad32ea-5178-4aa2-9015-b7fa12be83ff]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:04:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-72805362-de69-491c-978f-8b577745eba5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:05 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.855s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:05 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:04:05 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] Deleted volume successfully.
Jun 06 01:04:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bde410bc-77d8-4bdc-a576-cf15c78562d5 tempest-ServersNegativeTestJSON-112303491 None] Lock "cinder-a9353439-ed08-469d-8df1-7edbba5ba6f6-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:04:05 devstack sudo[89780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-72805362-de69-491c-978f-8b577745eba5
Jun 06 01:04:05 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:06 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-72805362-de69-491c-978f-8b577745eba5" returned: 0 in 0.936s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-72805362-de69-491c-978f-8b577745eba5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:06 devstack sudo[89785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-72805362-de69-491c-978f-8b577745eba5
Jun 06 01:04:06 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:07 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-72805362-de69-491c-978f-8b577745eba5" returned: 0 in 0.682s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:07 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] Lock "cinder-quobyte-72805362-de69-491c-978f-8b577745eba5" released by "delete_volume" :: held 1.671s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:04:07 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] Created reservations ['c5acc47d-0dd7-45a1-b72f-3ddbc9eb23e5', '49516513-494b-4c2b-9959-e08a1201e12d', 'e21b0c4f-04fc-4872-92aa-4797f6848655', '11e71936-4d21-486a-9578-8bc6cd317e9c'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:04:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:04:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:04:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:04:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:04:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:04:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:07 devstack sudo[89788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:04:07 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:08 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.037s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:08 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:04:08 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] Deleted volume successfully.
Jun 06 01:04:08 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e2f5f5c8-be55-4cd6-953d-9402879e9f22 tempest-ServersNegativeTestJSON-112303491 None] Lock "cinder-72805362-de69-491c-978f-8b577745eba5-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:04:17 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=39,cinder:SELECT=23,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:04:18 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=23,cinder:INSERT=7,cinder:UPDATE=33,cinder:DELETE=4 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:04:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b72aa520-59cf-4bab-9880-d3e9a6cfedf2 tempest-VolumesActionsTest-738214371 None] Acquiring lock "cinder-6bb6859f-4155-494b-bb80-a9ead3ab6696" by "attach_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:04:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b72aa520-59cf-4bab-9880-d3e9a6cfedf2 tempest-VolumesActionsTest-738214371 None] Lock "cinder-6bb6859f-4155-494b-bb80-a9ead3ab6696" acquired by "attach_volume" :: waited 0.037s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:04:20 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b72aa520-59cf-4bab-9880-d3e9a6cfedf2 tempest-VolumesActionsTest-738214371 None] Attaching volume 6bb6859f-4155-494b-bb80-a9ead3ab6696 to instance 3cb2c052-7e77-4b14-9c23-d9ba52e3c853 at mountpoint /dev/vdb on host None.
Jun 06 01:04:20 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b72aa520-59cf-4bab-9880-d3e9a6cfedf2 tempest-VolumesActionsTest-738214371 None] Attach volume completed successfully.
Jun 06 01:04:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b72aa520-59cf-4bab-9880-d3e9a6cfedf2 tempest-VolumesActionsTest-738214371 None] Lock "cinder-6bb6859f-4155-494b-bb80-a9ead3ab6696" released by "attach_volume" :: held 0.175s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:04:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-53011be4-6d95-4e98-9a42-7b3de303c6e7 tempest-VolumesActionsTest-738214371 None] Acquiring lock "cinder-6bb6859f-4155-494b-bb80-a9ead3ab6696-detach_volume" by "detach_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:04:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-53011be4-6d95-4e98-9a42-7b3de303c6e7 tempest-VolumesActionsTest-738214371 None] Lock "cinder-6bb6859f-4155-494b-bb80-a9ead3ab6696-detach_volume" acquired by "detach_volume" :: waited 0.055s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:04:21 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-53011be4-6d95-4e98-9a42-7b3de303c6e7 tempest-VolumesActionsTest-738214371 None] Detaching volume 6bb6859f-4155-494b-bb80-a9ead3ab6696 from instance 3cb2c052-7e77-4b14-9c23-d9ba52e3c853.
Jun 06 01:04:21 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-53011be4-6d95-4e98-9a42-7b3de303c6e7 tempest-VolumesActionsTest-738214371 None] Detach volume completed successfully.
Jun 06 01:04:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-53011be4-6d95-4e98-9a42-7b3de303c6e7 tempest-VolumesActionsTest-738214371 None] Lock "cinder-6bb6859f-4155-494b-bb80-a9ead3ab6696-detach_volume" released by "detach_volume" :: held 0.163s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Flow 'volume_create_manager' (df5135cb-9000-466a-a99a-647543da06ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0573779e-e250-4165-a5f6-e7ee9cd8d724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0573779e-e250-4165-a5f6-e7ee9cd8d724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-6689715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=418603a0-4647-498a-926a-9a7b737050d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a355f4ed63e4b4babd682a20165ebf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:04:28Z,use_quota=True,user_id='670301b5d35342809ed4804fa98041cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5539e18f-7aec-4223-80ba-d019f3868e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5539e18f-7aec-4223-80ba-d019f3868e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd59501-b4d5-4da2-9eda-1a1219a42d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd59501-b4d5-4da2-9eda-1a1219a42d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '418603a0-4647-498a-926a-9a7b737050d5', 'volume_name': 'volume-418603a0-4647-498a-926a-9a7b737050d5', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6421decf-0e94-4a3a-8290-8f8dd5197232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6421decf-0e94-4a3a-8290-8f8dd5197232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e20d34a-a07d-4d1a-ae09-f6ebfa049080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:04:27 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Volume 418603a0-4647-498a-926a-9a7b737050d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-418603a0-4647-498a-926a-9a7b737050d5', 'volume_size': 1}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-6689715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=418603a0-4647-498a-926a-9a7b737050d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a355f4ed63e4b4babd682a20165ebf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:04:28Z,use_quota=True,user_id='670301b5d35342809ed4804fa98041cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Creating volume 418603a0-4647-498a-926a-9a7b737050d5 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:04:27 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:04:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-418603a0-4647-498a-926a-9a7b737050d5 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:27 devstack sudo[90075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-418603a0-4647-498a-926a-9a7b737050d5 1073741824
Jun 06 01:04:27 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:29 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-418603a0-4647-498a-926a-9a7b737050d5 1073741824" returned: 0 in 1.122s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-418603a0-4647-498a-926a-9a7b737050d5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:29 devstack sudo[90099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-418603a0-4647-498a-926a-9a7b737050d5
Jun 06 01:04:29 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:29 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-418603a0-4647-498a-926a-9a7b737050d5" returned: 0 in 0.693s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:04:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:04:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e20d34a-a07d-4d1a-ae09-f6ebfa049080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-418603a0-4647-498a-926a-9a7b737050d5', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:04:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac634549-61ae-4d6e-a031-a0c269a02350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:04:29 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Volume volume-418603a0-4647-498a-926a-9a7b737050d5 (418603a0-4647-498a-926a-9a7b737050d5): created successfully
Jun 06 01:04:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac634549-61ae-4d6e-a031-a0c269a02350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:04:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Flow 'volume_create_manager' (df5135cb-9000-466a-a99a-647543da06ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:04:29 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-3788f20b-9f60-4ea6-8226-756c44d4207d req-75049a89-d423-4e25-b5fd-2db9058d0404 tempest-VolumesGetTestJSON-412957469 None] Created volume successfully.
Jun 06 01:04:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] Acquiring lock "cinder-418603a0-4647-498a-926a-9a7b737050d5-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:04:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] Lock "cinder-418603a0-4647-498a-926a-9a7b737050d5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:04:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] Acquiring lock "cinder-quobyte-418603a0-4647-498a-926a-9a7b737050d5" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:04:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] Lock "cinder-quobyte-418603a0-4647-498a-926a-9a7b737050d5" acquired by "delete_volume" :: waited 0.031s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:04:30 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85477f6-ca9e-4223-afc8-adf37e191ec6]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:04:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-418603a0-4647-498a-926a-9a7b737050d5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:30 devstack sudo[90106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-418603a0-4647-498a-926a-9a7b737050d5
Jun 06 01:04:30 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:31 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-418603a0-4647-498a-926a-9a7b737050d5" returned: 0 in 0.792s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-418603a0-4647-498a-926a-9a7b737050d5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:31 devstack sudo[90113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-418603a0-4647-498a-926a-9a7b737050d5
Jun 06 01:04:31 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:32 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-418603a0-4647-498a-926a-9a7b737050d5" returned: 0 in 0.754s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:32 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] Lock "cinder-quobyte-418603a0-4647-498a-926a-9a7b737050d5" released by "delete_volume" :: held 1.604s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:04:32 devstack cinder-volume[86581]: DEBUG cinder.quota [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] Created reservations ['e83897fe-be10-439e-86a6-abbb6de71189', 'a4af91af-3b7a-4f77-a85f-1850839d095e', '368c8f70-16b0-4342-8deb-37fa44014d81', 'dbf00007-5c94-4a50-8183-48b8df66c667'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:04:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:04:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:04:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:04:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:04:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:04:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:32 devstack sudo[90121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:04:32 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:32 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.648s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:32 devstack cinder-volume[86581]: DEBUG cinder.manager [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:04:32 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] Deleted volume successfully.
Jun 06 01:04:33 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-e3e07575-92de-4b22-a3db-6e5e9e28675c req-ee0b71ec-1f55-4ed4-a3f5-a552a62f5cca tempest-VolumesGetTestJSON-412957469 None] Lock "cinder-418603a0-4647-498a-926a-9a7b737050d5-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:04:42 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c6a9991d-34b7-4d52-a6cd-e530e6f22fb9 tempest-GroupSnapshotsV319Test-282226390 None] Group tempest-GroupSnapshotsV319Test-Group-157412982: creating
Jun 06 01:04:43 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c6a9991d-34b7-4d52-a6cd-e530e6f22fb9 tempest-GroupSnapshotsV319Test-282226390 None] Group tempest-GroupSnapshotsV319Test-Group-157412982: created successfully
Jun 06 01:04:43 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c6a9991d-34b7-4d52-a6cd-e530e6f22fb9 tempest-GroupSnapshotsV319Test-282226390 None] Create group completed successfully.
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Flow 'volume_create_manager' (04717cc5-14c6-4980-ac3b-a59a225c9494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a09ae8-b15f-4a3d-9eb1-128d8eedf3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a09ae8-b15f-4a3d-9eb1-128d8eedf3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-586971550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=91120bf1-d84e-43d9-9b0b-7459de38c559,host='devstack@QuobyteHD#QuobyteHD',id=ef7d8376-d309-4750-958b-4934dfaa7e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b80aaafd94e3d8bd450306d202c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:04:45Z,use_quota=True,user_id='fcabc6f6b67245e781fbd26311234a7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7d2e424-b97d-4466-9091-57a7f515fad2),volume_type_id=d7d2e424-b97d-4466-9091-57a7f515fad2)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e8f1d0b-6af3-4ba0-bf40-a8e814073f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e8f1d0b-6af3-4ba0-bf40-a8e814073f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66da41f-2f60-41c0-b39a-9592ea214430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66da41f-2f60-41c0-b39a-9592ea214430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef7d8376-d309-4750-958b-4934dfaa7e53', 'volume_name': 'volume-ef7d8376-d309-4750-958b-4934dfaa7e53', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258e0ca2-04d6-4829-add0-08f04ff6edb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258e0ca2-04d6-4829-add0-08f04ff6edb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7072157f-78ac-497d-af33-d04e47d9f7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:04:44 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Volume ef7d8376-d309-4750-958b-4934dfaa7e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef7d8376-d309-4750-958b-4934dfaa7e53', 'volume_size': 1}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=91120bf1-d84e-43d9-9b0b-7459de38c559,created_at=2026-06-05T23:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-586971550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=91120bf1-d84e-43d9-9b0b-7459de38c559,host='devstack@QuobyteHD#QuobyteHD',id=ef7d8376-d309-4750-958b-4934dfaa7e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b80aaafd94e3d8bd450306d202c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:04:45Z,use_quota=True,user_id='fcabc6f6b67245e781fbd26311234a7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7d2e424-b97d-4466-9091-57a7f515fad2),volume_type_id=d7d2e424-b97d-4466-9091-57a7f515fad2)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Creating volume ef7d8376-d309-4750-958b-4934dfaa7e53 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:04:44 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:04:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:44 devstack sudo[90349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53 1073741824
Jun 06 01:04:44 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:45 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53 1073741824" returned: 0 in 1.173s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:46 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53
Jun 06 01:04:46 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:46 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53" returned: 0 in 0.852s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] <== create_volume: return (2121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:04:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:04:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7072157f-78ac-497d-af33-d04e47d9f7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef7d8376-d309-4750-958b-4934dfaa7e53', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:04:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65334089-4dff-49d5-84e4-a3ad4213b6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:04:46 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Volume volume-ef7d8376-d309-4750-958b-4934dfaa7e53 (ef7d8376-d309-4750-958b-4934dfaa7e53): created successfully
Jun 06 01:04:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65334089-4dff-49d5-84e4-a3ad4213b6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:04:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Flow 'volume_create_manager' (04717cc5-14c6-4980-ac3b-a59a225c9494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:04:47 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-93a7aab5-4173-420c-887d-694b3f1e2280 tempest-GroupSnapshotsV319Test-282226390 None] Created volume successfully.
Jun 06 01:04:47 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] GroupSnapshot 4dc60c19-101d-440e-adc8-e64fbec84b42: creating.
Jun 06 01:04:47 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-be63c7ac-923b-4a05-85f9-45165ff92977 tempest-VolumesActionsTest-738214371 None] Acquiring lock "cinder-6bb6859f-4155-494b-bb80-a9ead3ab6696" by "attach_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:04:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] Group snapshot 4dc60c19-101d-440e-adc8-e64fbec84b42: creating. {{(pid=86581) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 06 01:04:47 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-be63c7ac-923b-4a05-85f9-45165ff92977 tempest-VolumesActionsTest-738214371 None] Lock "cinder-6bb6859f-4155-494b-bb80-a9ead3ab6696" acquired by "attach_volume" :: waited 0.030s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:04:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:04:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:04:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] Creating offline snapshot 2f3c2e22-7496-48c2-a00b-33fee69a66e2 of volume ef7d8376-d309-4750-958b-4934dfaa7e53 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:04:47 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6fd7e8-2c8c-4cad-879d-9613ee43d063]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:04:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:47 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-be63c7ac-923b-4a05-85f9-45165ff92977 tempest-VolumesActionsTest-738214371 None] Attaching volume 6bb6859f-4155-494b-bb80-a9ead3ab6696 to instance bda0ebfc-af43-44de-b178-bf5f0b8ed173 at mountpoint /dev/vdb on host None.
Jun 06 01:04:47 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-be63c7ac-923b-4a05-85f9-45165ff92977 tempest-VolumesActionsTest-738214371 None] Attach volume completed successfully.
Jun 06 01:04:47 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-be63c7ac-923b-4a05-85f9-45165ff92977 tempest-VolumesActionsTest-738214371 None] Lock "cinder-6bb6859f-4155-494b-bb80-a9ead3ab6696" released by "attach_volume" :: held 0.155s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:04:47 devstack sudo[90364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53
Jun 06 01:04:47 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:48 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ccf244f1-4b0a-4e55-91f5-385f2b4626e6 tempest-VolumesActionsTest-738214371 None] Acquiring lock "cinder-6bb6859f-4155-494b-bb80-a9ead3ab6696-detach_volume" by "detach_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:04:48 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ccf244f1-4b0a-4e55-91f5-385f2b4626e6 tempest-VolumesActionsTest-738214371 None] Lock "cinder-6bb6859f-4155-494b-bb80-a9ead3ab6696-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:04:48 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-ccf244f1-4b0a-4e55-91f5-385f2b4626e6 tempest-VolumesActionsTest-738214371 None] Detaching volume 6bb6859f-4155-494b-bb80-a9ead3ab6696 from instance bda0ebfc-af43-44de-b178-bf5f0b8ed173.
Jun 06 01:04:48 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-ccf244f1-4b0a-4e55-91f5-385f2b4626e6 tempest-VolumesActionsTest-738214371 None] Detach volume completed successfully.
Jun 06 01:04:48 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ccf244f1-4b0a-4e55-91f5-385f2b4626e6 tempest-VolumesActionsTest-738214371 None] Lock "cinder-6bb6859f-4155-494b-bb80-a9ead3ab6696-detach_volume" released by "detach_volume" :: held 0.077s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:04:48 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53" returned: 0 in 0.807s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:48 devstack sudo[90382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2 1G
Jun 06 01:04:48 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:49 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2 1G" returned: 0 in 0.850s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef7d8376-d309-4750-958b-4934dfaa7e53 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:49 devstack sudo[90391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef7d8376-d309-4750-958b-4934dfaa7e53 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2
Jun 06 01:04:49 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-81f9d159-92d0-4c42-9fd2-f8e9dd791226 req-a70ec0fa-32bd-47f9-97d1-18ceafc2253d tempest-ServerActionsTestOtherA-1623255764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:04:49 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef7d8376-d309-4750-958b-4934dfaa7e53 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2" returned: 0 in 0.648s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:49 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2 is being set with open permissions: ugo+rw: NotImplementedError
Jun 06 01:04:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:49 devstack sudo[90404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2
Jun 06 01:04:49 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:50 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2" returned: 0 in 0.771s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:50 devstack sudo[90445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.info
Jun 06 01:04:50 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:51 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.info" returned: 0 in 0.617s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:51 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 06 01:04:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:51 devstack sudo[90450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.info
Jun 06 01:04:51 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:51 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.info" returned: 0 in 0.635s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.427s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:04:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-81f9d159-92d0-4c42-9fd2-f8e9dd791226 req-a70ec0fa-32bd-47f9-97d1-18ceafc2253d tempest-ServerActionsTestOtherA-1623255764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.291s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:04:52 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f755c99-6f21-41bc-8203-49a7141c1eab]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:04:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-81f9d159-92d0-4c42-9fd2-f8e9dd791226 req-a70ec0fa-32bd-47f9-97d1-18ceafc2253d tempest-ServerActionsTestOtherA-1623255764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:52 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-287f25c3-9371-4afa-bc62-ad37f77c6537 tempest-GroupSnapshotsV319Test-282226390 None] group_snapshot 4dc60c19-101d-440e-adc8-e64fbec84b42: created successfully
Jun 06 01:04:52 devstack sudo[90456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd
Jun 06 01:04:52 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:52 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-81f9d159-92d0-4c42-9fd2-f8e9dd791226 req-a70ec0fa-32bd-47f9-97d1-18ceafc2253d tempest-ServerActionsTestOtherA-1623255764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd" returned: 0 in 0.691s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-81f9d159-92d0-4c42-9fd2-f8e9dd791226 req-a70ec0fa-32bd-47f9-97d1-18ceafc2253d tempest-ServerActionsTestOtherA-1623255764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.708s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:04:52 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-81f9d159-92d0-4c42-9fd2-f8e9dd791226 req-a70ec0fa-32bd-47f9-97d1-18ceafc2253d tempest-ServerActionsTestOtherA-1623255764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-56599a66-81c2-4376-95be-884d0d6916cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4d2e292-51ec-4955-8e14-e98a1c6a5684', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:04:52 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-81f9d159-92d0-4c42-9fd2-f8e9dd791226 req-a70ec0fa-32bd-47f9-97d1-18ceafc2253d tempest-ServerActionsTestOtherA-1623255764 None] attachment_update completed successfully.
Jun 06 01:04:53 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] group_snapshot 4dc60c19-101d-440e-adc8-e64fbec84b42: deleting
Jun 06 01:04:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] group_snapshot 4dc60c19-101d-440e-adc8-e64fbec84b42: deleting {{(pid=86581) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 06 01:04:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] Acquiring lock "cinder-quobyte-ef7d8376-d309-4750-958b-4934dfaa7e53" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:04:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] Lock "cinder-quobyte-ef7d8376-d309-4750-958b-4934dfaa7e53" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:04:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] Acquiring lock "cinder-quobyte-2f3c2e22-7496-48c2-a00b-33fee69a66e2" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:04:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] Lock "cinder-quobyte-2f3c2e22-7496-48c2-a00b-33fee69a66e2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:04:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] Deleting offline snapshot 2f3c2e22-7496-48c2-a00b-33fee69a66e2 of volume ef7d8376-d309-4750-958b-4934dfaa7e53 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:04:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] snapshot_file for this snap is: volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:04:53 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[28009cc6-5af9-4cfb-ac31-ae96c8375039]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:04:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:53 devstack sudo[90465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2
Jun 06 01:04:53 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:54 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2" returned: 0 in 0.746s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef7d8376-d309-4750-958b-4934dfaa7e53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:04:54 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[62045fec-5f8d-49a9-a846-2206a5d4400c]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:04:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:54 devstack sudo[90757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53
Jun 06 01:04:54 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:54 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53" returned: 0 in 0.742s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:54 devstack sudo[90856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2
Jun 06 01:04:54 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:55 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2" returned: 0 in 0.686s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:55 devstack sudo[90861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2
Jun 06 01:04:55 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:56 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53.2f3c2e22-7496-48c2-a00b-33fee69a66e2" returned: 0 in 0.595s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] Lock "cinder-quobyte-2f3c2e22-7496-48c2-a00b-33fee69a66e2" released by "_delete_snapshot" :: held 2.891s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:04:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] Lock "cinder-quobyte-ef7d8376-d309-4750-958b-4934dfaa7e53" released by "delete_snapshot" :: held 2.916s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:04:56 devstack cinder-volume[86581]: WARNING cinder.quota [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1590430229 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1590430229, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:04:56 devstack cinder-volume[86581]: WARNING cinder.quota [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1590430229 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1590430229, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:04:56 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] Created reservations ['24ac47db-ad57-4c59-9e7c-ad3fbe0de726', '59320fa1-7d92-476b-bee5-4dd9980e59dd', '907e431d-8409-4407-9e05-2521144d4f5e', '12f68b52-33b4-41a8-a49e-a8267e6f3ce9'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:04:56 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-ad3192f3-4369-4be3-b3c5-2de656344d9f tempest-GroupSnapshotsV319Test-282226390 None] group_snapshot 4dc60c19-101d-440e-adc8-e64fbec84b42: deleted successfully
Jun 06 01:04:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] Acquiring lock "cinder-quobyte-ef7d8376-d309-4750-958b-4934dfaa7e53" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:04:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] Lock "cinder-quobyte-ef7d8376-d309-4750-958b-4934dfaa7e53" acquired by "delete_volume" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:04:56 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a82ffb1-3053-4698-8b66-8af4337ce865]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:04:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:57 devstack sudo[90864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53
Jun 06 01:04:57 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:57 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53" returned: 0 in 0.818s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:57 devstack sudo[90869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53
Jun 06 01:04:57 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f0680a55-1cf5-4684-ac92-b82acec85414 tempest-VolumesActionsTest-738214371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:04:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f0680a55-1cf5-4684-ac92-b82acec85414 tempest-VolumesActionsTest-738214371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:04:58 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[43403f25-02db-4d2d-940c-81536e2c8a3e]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:04:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f0680a55-1cf5-4684-ac92-b82acec85414 tempest-VolumesActionsTest-738214371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:58 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef7d8376-d309-4750-958b-4934dfaa7e53" returned: 0 in 0.633s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] Lock "cinder-quobyte-ef7d8376-d309-4750-958b-4934dfaa7e53" released by "delete_volume" :: held 1.546s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:04:58 devstack sudo[90873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696
Jun 06 01:04:58 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:58 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] Created reservations ['d44e91d5-013c-456a-9e05-451156396614'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:04:58 devstack cinder-volume[86581]: WARNING cinder.quota [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1590430229 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1590430229, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:04:58 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] Created reservations ['9efb5457-e14c-46cb-a7fd-1bf973b06307', '573a2b17-04e7-4566-a91f-bfb1a3eb2a94', '734510b4-c9e2-46e7-9227-12fc92d6f0ba', '20e1d8e4-c7d0-47fe-9042-290460f46beb'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:04:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:04:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:04:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:04:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:04:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:04:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:58 devstack sudo[90875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:04:58 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:59 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f0680a55-1cf5-4684-ac92-b82acec85414 tempest-VolumesActionsTest-738214371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696" returned: 0 in 0.801s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:59 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd818253-68b6-414d-a055-d3d341d568e2]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:04:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f0680a55-1cf5-4684-ac92-b82acec85414 tempest-VolumesActionsTest-738214371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:59 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696
Jun 06 01:04:59 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:04:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:04:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:04:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:04:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:04:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:04:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:04:59 devstack sudo[90888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:04:59 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:04:59 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root
Jun 06 01:04:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.805s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:04:59 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:04:59 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-614c4301-77fd-4c16-a507-f5a4ada03818 tempest-GroupSnapshotsV319Test-282226390 None] Delete group completed successfully.
Jun 06 01:04:59 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:05:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Flow 'volume_create_manager' (ebfab169-0b29-4f90-8a86-6b89e650eff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:05:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05702d4e-e081-45d2-8356-e30a19f75ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:05:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05702d4e-e081-45d2-8356-e30a19f75ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1740442946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d520cb-2438-4025-a182-9aab375276fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5be28ee94a34f38b465fb62d53d4c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:05:00Z,use_quota=True,user_id='02bf1eec8ff84164aae2c3716da1c15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:05:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bb4f12-e830-4f2d-a3d1-812e2bdfbb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:05:00 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bb4f12-e830-4f2d-a3d1-812e2bdfbb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:05:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b795f70-a987-4783-9faa-9118070ffc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:05:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b795f70-a987-4783-9faa-9118070ffc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31d520cb-2438-4025-a182-9aab375276fc', 'volume_name': 'volume-31d520cb-2438-4025-a182-9aab375276fc', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:05:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57820766-d935-4bc5-a14b-b3f5bb724838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:05:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57820766-d935-4bc5-a14b-b3f5bb724838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:05:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c794db0-1f6a-47fb-af3c-478fabda0352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:05:00 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Volume 31d520cb-2438-4025-a182-9aab375276fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31d520cb-2438-4025-a182-9aab375276fc', 'volume_size': 1}
Jun 06 01:05:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:05:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f0680a55-1cf5-4684-ac92-b82acec85414 tempest-VolumesActionsTest-738214371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696" returned: 0 in 0.988s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f0680a55-1cf5-4684-ac92-b82acec85414 tempest-VolumesActionsTest-738214371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.ea6fc087-9481-4708-9290-131495235b46ddlk13r2.img {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:00 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.796s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:05:00 devstack sudo[90894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.ea6fc087-9481-4708-9290-131495235b46ddlk13r2.img
Jun 06 01:05:00 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:02 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-63f9f5a2-931f-48d9-a4f1-87c81561c1d6 req-6f3021c7-c087-4c8c-bf06-d162acf0a4b1 tempest-ServerActionsTestOtherA-1623255764 None] Terminate volume connection completed successfully.
Jun 06 01:05:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-63f9f5a2-931f-48d9-a4f1-87c81561c1d6 req-6f3021c7-c087-4c8c-bf06-d162acf0a4b1 tempest-ServerActionsTestOtherA-1623255764 None] Deleting attachment b4d2e292-51ec-4955-8e14-e98a1c6a5684. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:05:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-63f9f5a2-931f-48d9-a4f1-87c81561c1d6 req-2fe66e38-b385-466b-b0d0-1475b1ad7a13 tempest-ServerActionsTestOtherA-1623255764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:05:06 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f0680a55-1cf5-4684-ac92-b82acec85414 tempest-VolumesActionsTest-738214371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.ea6fc087-9481-4708-9290-131495235b46ddlk13r2.img" returned: 0 in 6.179s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:06 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aab0e6-d17e-4a2e-a2f5-83e38e47d9a5]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:05:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f0680a55-1cf5-4684-ac92-b82acec85414 tempest-VolumesActionsTest-738214371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:06 devstack sudo[91034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696
Jun 06 01:05:06 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:07 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f0680a55-1cf5-4684-ac92-b82acec85414 tempest-VolumesActionsTest-738214371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696" returned: 0 in 0.876s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:07 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-f0680a55-1cf5-4684-ac92-b82acec85414 tempest-VolumesActionsTest-738214371 None] Image conversion details: src /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.ea6fc087-9481-4708-9290-131495235b46ddlk13r2.img {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:05:07 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-f0680a55-1cf5-4684-ac92-b82acec85414 tempest-VolumesActionsTest-738214371 None] Converted 1024.00 MB image at 165.71 MB/s
Jun 06 01:05:07 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-f0680a55-1cf5-4684-ac92-b82acec85414 tempest-VolumesActionsTest-738214371 None] ea6fc087-9481-4708-9290-131495235b46 was raw, no need to convert to raw {{(pid=86581) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Jun 06 01:05:08 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-0ae69179-2cd1-48a4-aa4f-fc286d832e19 tempest-GroupsV320Test-1869398495 None] Group tempest-GroupsV320Test-Group-3476064: creating
Jun 06 01:05:08 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-0ae69179-2cd1-48a4-aa4f-fc286d832e19 tempest-GroupsV320Test-1869398495 None] Group tempest-GroupsV320Test-Group-3476064: created successfully
Jun 06 01:05:08 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-0ae69179-2cd1-48a4-aa4f-fc286d832e19 tempest-GroupsV320Test-1869398495 None] Create group completed successfully.
Jun 06 01:05:09 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-8ad5d18e-a869-4d9f-af94-632bb4ffcc7d tempest-GroupsV320Test-1869398495 None] Created reservations ['44f88828-d5fa-440b-b5c8-5f890d3f8310'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:05:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8ad5d18e-a869-4d9f-af94-632bb4ffcc7d tempest-GroupsV320Test-1869398495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:05:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8ad5d18e-a869-4d9f-af94-632bb4ffcc7d tempest-GroupsV320Test-1869398495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:05:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8ad5d18e-a869-4d9f-af94-632bb4ffcc7d tempest-GroupsV320Test-1869398495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:05:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8ad5d18e-a869-4d9f-af94-632bb4ffcc7d tempest-GroupsV320Test-1869398495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:05:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8ad5d18e-a869-4d9f-af94-632bb4ffcc7d tempest-GroupsV320Test-1869398495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:05:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8ad5d18e-a869-4d9f-af94-632bb4ffcc7d tempest-GroupsV320Test-1869398495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:09 devstack sudo[91059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:05:09 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:10 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8ad5d18e-a869-4d9f-af94-632bb4ffcc7d tempest-GroupsV320Test-1869398495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.689s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:10 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-8ad5d18e-a869-4d9f-af94-632bb4ffcc7d tempest-GroupsV320Test-1869398495 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:05:10 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-8ad5d18e-a869-4d9f-af94-632bb4ffcc7d tempest-GroupsV320Test-1869398495 None] Delete group completed successfully.
Jun 06 01:05:19 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=58,cinder:UPDATE=49,cinder:INSERT=9 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:05:19 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=67,cinder:INSERT=12,cinder:UPDATE=43,cinder:DELETE=3 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:05:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f0680a55-1cf5-4684-ac92-b82acec85414 tempest-VolumesActionsTest-738214371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.561s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:05:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f0680a55-1cf5-4684-ac92-b82acec85414 tempest-VolumesActionsTest-738214371 None] Uploaded volume to glance image-id: ea6fc087-9481-4708-9290-131495235b46. {{(pid=86581) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 06 01:05:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.730s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:05:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1740442946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d520cb-2438-4025-a182-9aab375276fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5be28ee94a34f38b465fb62d53d4c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:05:00Z,use_quota=True,user_id='02bf1eec8ff84164aae2c3716da1c15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:05:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Creating volume 31d520cb-2438-4025-a182-9aab375276fc {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:05:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:05:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:05:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:05:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:05:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:05:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:05:28 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:05:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-31d520cb-2438-4025-a182-9aab375276fc 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:28 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f0680a55-1cf5-4684-ac92-b82acec85414 tempest-VolumesActionsTest-738214371 None] Copy volume to image completed successfully.
Jun 06 01:05:28 devstack sudo[91074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-31d520cb-2438-4025-a182-9aab375276fc 1073741824
Jun 06 01:05:28 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:29 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-31d520cb-2438-4025-a182-9aab375276fc 1073741824" returned: 0 in 0.831s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-31d520cb-2438-4025-a182-9aab375276fc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:29 devstack sudo[91080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-31d520cb-2438-4025-a182-9aab375276fc
Jun 06 01:05:29 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:30 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-31d520cb-2438-4025-a182-9aab375276fc" returned: 0 in 0.660s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:05:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:05:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-63f9f5a2-931f-48d9-a4f1-87c81561c1d6 req-2fe66e38-b385-466b-b0d0-1475b1ad7a13 tempest-ServerActionsTestOtherA-1623255764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.122s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:05:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c794db0-1f6a-47fb-af3c-478fabda0352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31d520cb-2438-4025-a182-9aab375276fc', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:05:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3520eb6c-ba87-431d-9f99-565966748463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:05:30 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b0a5a6-c6cd-4ad5-9b3f-b3f29a106f85]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:05:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-63f9f5a2-931f-48d9-a4f1-87c81561c1d6 req-2fe66e38-b385-466b-b0d0-1475b1ad7a13 tempest-ServerActionsTestOtherA-1623255764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:30 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Volume volume-31d520cb-2438-4025-a182-9aab375276fc (31d520cb-2438-4025-a182-9aab375276fc): created successfully
Jun 06 01:05:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3520eb6c-ba87-431d-9f99-565966748463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:05:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Flow 'volume_create_manager' (ebfab169-0b29-4f90-8a86-6b89e650eff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:05:30 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b00dbd5a-514e-430b-be2c-03fcefd0fd3e tempest-AttachVolumeShelveTestJSON-2132915721 None] Created volume successfully.
Jun 06 01:05:30 devstack sudo[91083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd
Jun 06 01:05:30 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:31 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-63f9f5a2-931f-48d9-a4f1-87c81561c1d6 req-2fe66e38-b385-466b-b0d0-1475b1ad7a13 tempest-ServerActionsTestOtherA-1623255764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd" returned: 0 in 0.815s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-63f9f5a2-931f-48d9-a4f1-87c81561c1d6 req-2fe66e38-b385-466b-b0d0-1475b1ad7a13 tempest-ServerActionsTestOtherA-1623255764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.846s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:05:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-63f9f5a2-931f-48d9-a4f1-87c81561c1d6 req-2fe66e38-b385-466b-b0d0-1475b1ad7a13 tempest-ServerActionsTestOtherA-1623255764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-56599a66-81c2-4376-95be-884d0d6916cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75d9f7f7-dfb1-4352-a12e-d58dacf737f4', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:05:31 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-63f9f5a2-931f-48d9-a4f1-87c81561c1d6 req-2fe66e38-b385-466b-b0d0-1475b1ad7a13 tempest-ServerActionsTestOtherA-1623255764 None] attachment_update completed successfully.
Jun 06 01:05:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:05:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:05:31 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ac8307-dbe3-4f89-a371-e775cd704adb]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:05:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:31 devstack sudo[91088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696
Jun 06 01:05:31 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:32 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696" returned: 0 in 0.840s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:32 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6cdc95-39fa-4aa3-94e4-273866025410]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:05:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:32 devstack sudo[91098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696
Jun 06 01:05:32 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:33 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696" returned: 0 in 0.878s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.d65e9a5f-076e-4768-b3d6-862a2389737el1gre6rp.img {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:33 devstack sudo[91104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.d65e9a5f-076e-4768-b3d6-862a2389737el1gre6rp.img
Jun 06 01:05:33 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:40 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.d65e9a5f-076e-4768-b3d6-862a2389737el1gre6rp.img" returned: 0 in 7.050s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:40 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d2041a-84f1-4137-a2ba-7ddd21ed6dc0]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:05:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:40 devstack sudo[91620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696
Jun 06 01:05:40 devstack sudo[91620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:41 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=5,cinder:INSERT=1,cinder:SELECT=6 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:05:41 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:05:42 devstack sudo[91620]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696" returned: 0 in 1.815s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:42 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] Image conversion details: src /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696, size 1024.00 MB, duration 7.05 sec, destination /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.d65e9a5f-076e-4768-b3d6-862a2389737el1gre6rp.img {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:05:42 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] Converted 1024.00 MB image at 145.21 MB/s
Jun 06 01:05:42 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] d65e9a5f-076e-4768-b3d6-862a2389737e was raw, converting to qcow2 {{(pid=86581) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Jun 06 01:05:42 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a6fd40-edc1-493e-b893-bfb096d81271]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:05:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.d65e9a5f-076e-4768-b3d6-862a2389737el1gre6rp.img {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:42 devstack sudo[91644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.d65e9a5f-076e-4768-b3d6-862a2389737el1gre6rp.img
Jun 06 01:05:42 devstack sudo[91644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:43 devstack sudo[91644]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.d65e9a5f-076e-4768-b3d6-862a2389737el1gre6rp.img" returned: 0 in 1.491s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.d65e9a5f-076e-4768-b3d6-862a2389737el1gre6rp.img {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:43 devstack sudo[91650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.d65e9a5f-076e-4768-b3d6-862a2389737el1gre6rp.img
Jun 06 01:05:43 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:44 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.d65e9a5f-076e-4768-b3d6-862a2389737el1gre6rp.img" returned: 1 in 0.972s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.d65e9a5f-076e-4768-b3d6-862a2389737el1gre6rp.img' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:05:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.d65e9a5f-076e-4768-b3d6-862a2389737el1gre6rp.img /opt/stack/data/cinder/conversion/vol_upload_a1s3_fed {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:44 devstack sudo[91655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.d65e9a5f-076e-4768-b3d6-862a2389737el1gre6rp.img /opt/stack/data/cinder/conversion/vol_upload_a1s3_fed
Jun 06 01:05:44 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:45 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.d65e9a5f-076e-4768-b3d6-862a2389737el1gre6rp.img /opt/stack/data/cinder/conversion/vol_upload_a1s3_fed" returned: 0 in 0.668s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:45 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] Image conversion details: src /opt/stack/data/cinder/conversion/6bb6859f-4155-494b-bb80-a9ead3ab6696.temp_image.d65e9a5f-076e-4768-b3d6-862a2389737el1gre6rp.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_a1s3_fed {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:05:45 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] Converted 1024.00 MB image at 1024.00 MB/s
Jun 06 01:05:45 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0b07d2-f0a6-4543-9b13-5b79483bdb63]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:05:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a1s3_fed {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:45 devstack sudo[91662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a1s3_fed
Jun 06 01:05:45 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:46 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a1s3_fed" returned: 0 in 0.914s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.655s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:05:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] Uploaded volume to glance image-id: d65e9a5f-076e-4768-b3d6-862a2389737e. {{(pid=86581) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 06 01:05:48 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-1fbb1185-fbf6-460e-8368-6d5ad6328ca6 tempest-VolumesActionsTest-738214371 None] Copy volume to image completed successfully.
Jun 06 01:05:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] Acquiring lock "cinder-6bb6859f-4155-494b-bb80-a9ead3ab6696-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:05:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] Lock "cinder-6bb6859f-4155-494b-bb80-a9ead3ab6696-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:05:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] Acquiring lock "cinder-quobyte-6bb6859f-4155-494b-bb80-a9ead3ab6696" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:05:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] Lock "cinder-quobyte-6bb6859f-4155-494b-bb80-a9ead3ab6696" acquired by "delete_volume" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:05:49 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d897eb-9c58-45db-842c-4b4a188f9944]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:05:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:49 devstack sudo[91670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696
Jun 06 01:05:49 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:50 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696" returned: 0 in 0.953s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:50 devstack sudo[91675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696
Jun 06 01:05:50 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:51 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bb6859f-4155-494b-bb80-a9ead3ab6696" returned: 0 in 1.072s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] Lock "cinder-quobyte-6bb6859f-4155-494b-bb80-a9ead3ab6696" released by "delete_volume" :: held 2.092s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:05:51 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] Created reservations ['7298ca85-14a3-4132-93fa-73ef63ee721d', '729ebe4c-e654-4568-9f2d-f981da2e6f75', '7e96e7f8-04a0-41c9-ac47-ada45b3f18ed', '565e28f7-8f68-435f-88dd-dc113e41bacc'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:05:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:05:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:05:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:05:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:05:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:05:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:51 devstack sudo[91680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:05:51 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:52 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.837s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:52 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:05:52 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] Deleted volume successfully.
Jun 06 01:05:52 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-efe71681-4547-407e-be55-3b203e8d21bc tempest-VolumesActionsTest-738214371 None] Lock "cinder-6bb6859f-4155-494b-bb80-a9ead3ab6696-delete_volume" released by "delete_volume" :: held 3.330s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:05:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-78503bdb-d4a9-4826-a258-fd413b4ab331 req-8dea4767-f975-459b-ac04-0589e5257571 tempest-AttachVolumeShelveTestJSON-2132915721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:05:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-78503bdb-d4a9-4826-a258-fd413b4ab331 req-8dea4767-f975-459b-ac04-0589e5257571 tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:05:55 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[2915cb5d-cc21-4794-b474-b3dda2657c83]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:05:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-78503bdb-d4a9-4826-a258-fd413b4ab331 req-8dea4767-f975-459b-ac04-0589e5257571 tempest-AttachVolumeShelveTestJSON-2132915721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-31d520cb-2438-4025-a182-9aab375276fc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:55 devstack sudo[91749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-31d520cb-2438-4025-a182-9aab375276fc
Jun 06 01:05:55 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:56 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root
Jun 06 01:05:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-78503bdb-d4a9-4826-a258-fd413b4ab331 req-8dea4767-f975-459b-ac04-0589e5257571 tempest-AttachVolumeShelveTestJSON-2132915721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-31d520cb-2438-4025-a182-9aab375276fc" returned: 0 in 0.905s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:05:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-78503bdb-d4a9-4826-a258-fd413b4ab331 req-8dea4767-f975-459b-ac04-0589e5257571 tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.942s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:05:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-78503bdb-d4a9-4826-a258-fd413b4ab331 req-8dea4767-f975-459b-ac04-0589e5257571 tempest-AttachVolumeShelveTestJSON-2132915721 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-31d520cb-2438-4025-a182-9aab375276fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15c5bfd5-337f-487c-bdaf-83111564ca2c', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:05:56 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-78503bdb-d4a9-4826-a258-fd413b4ab331 req-8dea4767-f975-459b-ac04-0589e5257571 tempest-AttachVolumeShelveTestJSON-2132915721 None] attachment_update completed successfully.
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:59 devstack sudo[91756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:05:59 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Flow 'volume_create_manager' (afff7d4b-1840-4240-84f6-b916067fca54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0589bee-130a-4e4c-9c45-23194ee37ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0589bee-130a-4e4c-9c45-23194ee37ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-728835024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3304d7-feee-45af-9d1c-efc87c4243e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd684e2ab72a4672b3a26352d337c45b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:06:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:06:00Z,use_quota=True,user_id='d454eb6bd9e74b1381df7a73214c40e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e164911-f9d7-4810-bf8e-089564c0c1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e164911-f9d7-4810-bf8e-089564c0c1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012edae6-b4a7-47ca-9f67-dde13dfadcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012edae6-b4a7-47ca-9f67-dde13dfadcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e3304d7-feee-45af-9d1c-efc87c4243e5', 'volume_name': 'volume-8e3304d7-feee-45af-9d1c-efc87c4243e5', 'volume_size': 2}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ad4529-fe46-4c80-b6ea-bbd9c195471b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ad4529-fe46-4c80-b6ea-bbd9c195471b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a2bc95-a199-4dc4-99d5-241131e97674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:05:59 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Volume 8e3304d7-feee-45af-9d1c-efc87c4243e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e3304d7-feee-45af-9d1c-efc87c4243e5', 'volume_size': 2}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-728835024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3304d7-feee-45af-9d1c-efc87c4243e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd684e2ab72a4672b3a26352d337c45b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:06:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:06:00Z,use_quota=True,user_id='d454eb6bd9e74b1381df7a73214c40e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Creating volume 8e3304d7-feee-45af-9d1c-efc87c4243e5 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:05:59 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:05:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8e3304d7-feee-45af-9d1c-efc87c4243e5 2147483648 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:05:59 devstack sudo[91758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8e3304d7-feee-45af-9d1c-efc87c4243e5 2147483648
Jun 06 01:05:59 devstack sudo[91758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:00 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.878s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:06:00 devstack sudo[91758]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8e3304d7-feee-45af-9d1c-efc87c4243e5 2147483648" returned: 0 in 1.058s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8e3304d7-feee-45af-9d1c-efc87c4243e5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:00 devstack sudo[91766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8e3304d7-feee-45af-9d1c-efc87c4243e5
Jun 06 01:06:00 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:01 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8e3304d7-feee-45af-9d1c-efc87c4243e5" returned: 0 in 0.650s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:06:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a2bc95-a199-4dc4-99d5-241131e97674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e3304d7-feee-45af-9d1c-efc87c4243e5', 'volume_size': 2}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d30b333-c8df-4b06-ae58-e2b42240311e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:01 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Volume volume-8e3304d7-feee-45af-9d1c-efc87c4243e5 (8e3304d7-feee-45af-9d1c-efc87c4243e5): created successfully
Jun 06 01:06:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d30b333-c8df-4b06-ae58-e2b42240311e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Flow 'volume_create_manager' (afff7d4b-1840-4240-84f6-b916067fca54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:06:01 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-32f3ee13-8c04-4f94-a606-a5e4dfbda3c0 tempest-VolumesCloneNegativeTest-674864761 None] Created volume successfully.
Jun 06 01:06:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] Acquiring lock "cinder-8e3304d7-feee-45af-9d1c-efc87c4243e5-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:06:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] Lock "cinder-8e3304d7-feee-45af-9d1c-efc87c4243e5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:06:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] Acquiring lock "cinder-quobyte-8e3304d7-feee-45af-9d1c-efc87c4243e5" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:06:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] Lock "cinder-quobyte-8e3304d7-feee-45af-9d1c-efc87c4243e5" acquired by "delete_volume" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:06:01 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc0e3d8-85c4-410b-b221-33e61f602354]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:06:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8e3304d7-feee-45af-9d1c-efc87c4243e5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:02 devstack sudo[91769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8e3304d7-feee-45af-9d1c-efc87c4243e5
Jun 06 01:06:02 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:02 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8e3304d7-feee-45af-9d1c-efc87c4243e5" returned: 0 in 0.845s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8e3304d7-feee-45af-9d1c-efc87c4243e5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:02 devstack sudo[91777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8e3304d7-feee-45af-9d1c-efc87c4243e5
Jun 06 01:06:02 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:03 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8e3304d7-feee-45af-9d1c-efc87c4243e5" returned: 0 in 0.712s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] Lock "cinder-quobyte-8e3304d7-feee-45af-9d1c-efc87c4243e5" released by "delete_volume" :: held 1.608s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:06:03 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] Created reservations ['f0801bb3-ad88-4880-8ed7-1ca30e1c1216', '00ff2a3f-7fc1-4297-888f-9a41b27b42cd', '8a381258-dd86-45f4-96e8-c43939bce8c4', 'f6031840-8e3a-401c-8e83-a313dd4b16fa'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:06:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:06:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:06:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:03 devstack sudo[91782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:06:03 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:04 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.884s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:04 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:06:04 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] Deleted volume successfully.
Jun 06 01:06:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-099ba713-07b9-4ffa-86c5-b743b269417e tempest-VolumesCloneNegativeTest-674864761 None] Lock "cinder-8e3304d7-feee-45af-9d1c-efc87c4243e5-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:06:05 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-d9120d47-7b3d-49cb-844f-5baa753295cd req-b928b4d5-46f5-48ae-889a-ea94cc88443a tempest-ServerActionsTestOtherA-1623255764 None] Terminate volume connection completed successfully.
Jun 06 01:06:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-d9120d47-7b3d-49cb-844f-5baa753295cd req-b928b4d5-46f5-48ae-889a-ea94cc88443a tempest-ServerActionsTestOtherA-1623255764 None] Deleting attachment 75d9f7f7-dfb1-4352-a12e-d58dacf737f4. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:06:08 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:06:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Flow 'volume_create_manager' (add792f2-e97a-4861-a480-5743b6d694b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:06:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60d79a30-aa2e-4546-a332-0c0e78034291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60d79a30-aa2e-4546-a332-0c0e78034291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-125175751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d657e8-7de9-4f15-87f0-0b868cedd660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ffce065594495496136bf9652b3314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:06:08Z,use_quota=True,user_id='b46cab7384f94c8489f8289dce0ea676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09977834-6343-4e68-a26f-8f9b4646e807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09977834-6343-4e68-a26f-8f9b4646e807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21a7ed2-24af-4b62-a862-7cf71682bf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:08 devstack cinder-volume[86581]: DEBUG cinder.image.glance [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Creating Keystone auth plugin from conf {{(pid=86581) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 06 01:06:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21a7ed2-24af-4b62-a862-7cf71682bf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f3d657e8-7de9-4f15-87f0-0b868cedd660', 'volume_name': 'volume-f3d657e8-7de9-4f15-87f0-0b868cedd660', 'volume_size': 1, 'image_id': '072119e4-dec9-4da3-882b-9b4b26824482', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30202bd94f9947968da8019925562da0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '072119e4-dec9-4da3-882b-9b4b26824482', 'created_at': datetime.datetime(2026, 6, 5, 22, 55, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 22, 55, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072119e4-dec9-4da3-882b-9b4b26824482/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2e89d00>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7515fb-e322-4ffe-af10-eeee371134d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7515fb-e322-4ffe-af10-eeee371134d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65087c3-7365-412e-ad04-9ebbe94c143b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:09 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Volume f3d657e8-7de9-4f15-87f0-0b868cedd660: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f3d657e8-7de9-4f15-87f0-0b868cedd660', 'volume_size': 1, 'image_id': '072119e4-dec9-4da3-882b-9b4b26824482', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30202bd94f9947968da8019925562da0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '072119e4-dec9-4da3-882b-9b4b26824482', 'created_at': datetime.datetime(2026, 6, 5, 22, 55, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 22, 55, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072119e4-dec9-4da3-882b-9b4b26824482/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2e89d00>}
Jun 06 01:06:09 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Trying to clone f3d657e8-7de9-4f15-87f0-0b868cedd660 from image 072119e4-dec9-4da3-882b-9b4b26824482 at location (None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}]). {{(pid=86581) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Jun 06 01:06:09 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_a16t9mqpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jun 06 01:06:09 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Image download 20.69 MB at 20.69 MB/s
Jun 06 01:06:09 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc996a20-da08-4926-83ef-0e508d0adc3a]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:06:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_a16t9mqpdevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:09 devstack sudo[91897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_a16t9mqpdevstack@QuobyteHD
Jun 06 01:06:09 devstack sudo[91897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:10 devstack sudo[91897]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_a16t9mqpdevstack@QuobyteHD" returned: 0 in 0.953s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:10 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Temporary image 072119e4-dec9-4da3-882b-9b4b26824482 is fetched for user b46cab7384f94c8489f8289dce0ea676. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jun 06 01:06:10 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd7480b-bb44-41ab-bd80-a06818b27c13]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:06:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_a16t9mqpdevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:11 devstack sudo[91904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_a16t9mqpdevstack@QuobyteHD
Jun 06 01:06:11 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:11 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_a16t9mqpdevstack@QuobyteHD" returned: 0 in 0.798s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-125175751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d657e8-7de9-4f15-87f0-0b868cedd660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ffce065594495496136bf9652b3314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:06:08Z,use_quota=True,user_id='b46cab7384f94c8489f8289dce0ea676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:06:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Creating volume f3d657e8-7de9-4f15-87f0-0b868cedd660 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:06:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:06:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:06:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:06:11 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:06:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:11 devstack sudo[91910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 1073741824
Jun 06 01:06:11 devstack sudo[91910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:12 devstack sudo[91910]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 1073741824" returned: 0 in 1.054s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:12 devstack sudo[91985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660
Jun 06 01:06:12 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:13 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660" returned: 0 in 0.700s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:06:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:13 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Attempting download of 072119e4-dec9-4da3-882b-9b4b26824482 ((None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}])) to volume f3d657e8-7de9-4f15-87f0-0b868cedd660. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jun 06 01:06:13 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cd96a9-40b2-4bcd-8fb3-3b515168c3b3]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:06:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_9zjxpn9f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:13 devstack sudo[91992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_9zjxpn9f
Jun 06 01:06:13 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:14 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_9zjxpn9f" returned: 0 in 0.758s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_9zjxpn9f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:14 devstack sudo[91997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_9zjxpn9f
Jun 06 01:06:14 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:15 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_9zjxpn9f" returned: 1 in 0.787s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_9zjxpn9f' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:06:15 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea26e34-5680-4501-81c5-5a26366b6194]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:06:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_a16t9mqpdevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:15 devstack sudo[92333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_a16t9mqpdevstack@QuobyteHD
Jun 06 01:06:15 devstack sudo[92333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:16 devstack sudo[92333]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_a16t9mqpdevstack@QuobyteHD" returned: 0 in 1.235s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:16 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] 072119e4-dec9-4da3-882b-9b4b26824482 was qcow2, converting to raw {{(pid=86581) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jun 06 01:06:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_a16t9mqpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:16 devstack sudo[92385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_a16t9mqpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660
Jun 06 01:06:16 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] Acquiring lock "cinder-56599a66-81c2-4376-95be-884d0d6916cd-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:06:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] Lock "cinder-56599a66-81c2-4376-95be-884d0d6916cd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:06:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] Acquiring lock "cinder-quobyte-56599a66-81c2-4376-95be-884d0d6916cd" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:06:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] Lock "cinder-quobyte-56599a66-81c2-4376-95be-884d0d6916cd" acquired by "delete_volume" :: waited 0.025s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:06:16 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfd70aa-879e-47e5-8f45-7436dbb5e64f]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:06:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:16 devstack sudo[92387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd
Jun 06 01:06:16 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:17 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd" returned: 0 in 0.867s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:17 devstack sudo[92401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd
Jun 06 01:06:17 devstack sudo[92401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:18 devstack sudo[92401]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-56599a66-81c2-4376-95be-884d0d6916cd" returned: 0 in 0.676s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:18 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] Lock "cinder-quobyte-56599a66-81c2-4376-95be-884d0d6916cd" released by "delete_volume" :: held 1.619s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:06:18 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] Created reservations ['c639b014-cc8b-45e0-8129-1c6767904d3f', '4891a5c5-7f6e-4707-8bf0-fc3a6deac4f7', 'afcd44d3-b8de-4dab-9b65-a2e996285262', '80744a62-3efe-400f-a396-bb87dc3b64e0'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:06:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:18 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:06:18 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:06:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:18 devstack sudo[92405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:06:18 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:18 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_a16t9mqpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660" returned: 0 in 2.132s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:18 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_a16t9mqpdevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:06:18 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Converted 112.00 MB image at 52.49 MB/s
Jun 06 01:06:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:18 devstack sudo[92407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 1G
Jun 06 01:06:18 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:19 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.623s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:19 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:06:19 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] Deleted volume successfully.
Jun 06 01:06:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6e34dd6e-784a-410d-a6ce-afebb804444c tempest-ServerActionsTestOtherA-1623255764 None] Lock "cinder-56599a66-81c2-4376-95be-884d0d6916cd-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:06:19 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 1G" returned: 0 in 0.664s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:19 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb80a6b9-88ce-4598-a4f9-e70286b865bd]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:06:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:19 devstack sudo[92414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660
Jun 06 01:06:19 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:19 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660" returned: 0 in 0.707s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:20 devstack sudo[92418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660
Jun 06 01:06:20 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:20 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660" returned: 1 in 0.763s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:06:20 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Downloaded image 072119e4-dec9-4da3-882b-9b4b26824482 ((None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}])) to volume f3d657e8-7de9-4f15-87f0-0b868cedd660 successfully. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jun 06 01:06:20 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Temporary image 072119e4-dec9-4da3-882b-9b4b26824482 for user b46cab7384f94c8489f8289dce0ea676 is deleted. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jun 06 01:06:20 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Marking volume f3d657e8-7de9-4f15-87f0-0b868cedd660 as bootable. {{(pid=86581) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jun 06 01:06:20 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Copying metadata from image 072119e4-dec9-4da3-882b-9b4b26824482 to f3d657e8-7de9-4f15-87f0-0b868cedd660. {{(pid=86581) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 06 01:06:20 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Creating volume glance metadata for volume f3d657e8-7de9-4f15-87f0-0b868cedd660 backed by image 072119e4-dec9-4da3-882b-9b4b26824482 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '072119e4-dec9-4da3-882b-9b4b26824482', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86581) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 06 01:06:20 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65087c3-7365-412e-ad04-9ebbe94c143b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3d657e8-7de9-4f15-87f0-0b868cedd660', 'volume_size': 1, 'image_id': '072119e4-dec9-4da3-882b-9b4b26824482', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30202bd94f9947968da8019925562da0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '072119e4-dec9-4da3-882b-9b4b26824482', 'created_at': datetime.datetime(2026, 6, 5, 22, 55, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 22, 55, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072119e4-dec9-4da3-882b-9b4b26824482/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2e89d00>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:20 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a8f0e7-455a-4344-86dd-c2eb51f603c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:20 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Volume volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 (f3d657e8-7de9-4f15-87f0-0b868cedd660): created successfully
Jun 06 01:06:20 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a8f0e7-455a-4344-86dd-c2eb51f603c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:20 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Flow 'volume_create_manager' (add792f2-e97a-4861-a480-5743b6d694b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:06:20 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-e0977ca7-eb50-4d60-8f4e-79a1c0846061 tempest-VolumesExtendTest-1190182638 None] Created volume successfully.
Jun 06 01:06:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cbb8e928-6a9b-4a32-9cfc-ad2b92c69394 tempest-VolumesExtendTest-1190182638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cbb8e928-6a9b-4a32-9cfc-ad2b92c69394 tempest-VolumesExtendTest-1190182638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:21 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8b361f-7c60-4357-96fc-c15304bef919]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:06:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cbb8e928-6a9b-4a32-9cfc-ad2b92c69394 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:21 devstack sudo[92463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660
Jun 06 01:06:21 devstack sudo[92463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:23 devstack sudo[92463]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cbb8e928-6a9b-4a32-9cfc-ad2b92c69394 tempest-VolumesExtendTest-1190182638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660" returned: 0 in 1.364s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cbb8e928-6a9b-4a32-9cfc-ad2b92c69394 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:23 devstack sudo[92473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660
Jun 06 01:06:23 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:24 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cbb8e928-6a9b-4a32-9cfc-ad2b92c69394 tempest-VolumesExtendTest-1190182638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660" returned: 1 in 1.229s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cbb8e928-6a9b-4a32-9cfc-ad2b92c69394 tempest-VolumesExtendTest-1190182638 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:06:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cbb8e928-6a9b-4a32-9cfc-ad2b92c69394 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 2G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cbb8e928-6a9b-4a32-9cfc-ad2b92c69394 tempest-VolumesExtendTest-1190182638 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 2G" returned: 0 in 0.098s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cbb8e928-6a9b-4a32-9cfc-ad2b92c69394 tempest-VolumesExtendTest-1190182638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.839s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:24 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-cbb8e928-6a9b-4a32-9cfc-ad2b92c69394 tempest-VolumesExtendTest-1190182638 None] Extend volume completed successfully.
Jun 06 01:06:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Acquiring lock "cinder-f3d657e8-7de9-4f15-87f0-0b868cedd660-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:06:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Lock "cinder-f3d657e8-7de9-4f15-87f0-0b868cedd660-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:06:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Acquiring lock "cinder-quobyte-f3d657e8-7de9-4f15-87f0-0b868cedd660" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:06:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Lock "cinder-quobyte-f3d657e8-7de9-4f15-87f0-0b868cedd660" acquired by "delete_volume" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:06:25 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba24db9-c652-44c2-884d-d198343c5944]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:06:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:25 devstack sudo[92500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660
Jun 06 01:06:25 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:26 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660" returned: 0 in 0.729s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:26 devstack sudo[92506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660
Jun 06 01:06:26 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:26 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660" returned: 1 in 0.728s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:06:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:26 devstack sudo[92511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660
Jun 06 01:06:26 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:27 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f3d657e8-7de9-4f15-87f0-0b868cedd660" returned: 0 in 0.761s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:27 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Lock "cinder-quobyte-f3d657e8-7de9-4f15-87f0-0b868cedd660" released by "delete_volume" :: held 2.305s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:06:27 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Created reservations ['7bcb78f2-4eb2-4595-9805-7c400c41c9c8', '49a45a9e-2d79-4558-bcd9-189e6a6162f8', '72c2bf49-6783-4fc9-af07-366ab5ec85ea', 'd84286be-9034-48e6-9ad7-040d4a1239b2'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:06:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:06:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:06:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:27 devstack sudo[92514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:06:27 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:28 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.683s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:28 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:06:28 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Deleted volume successfully.
Jun 06 01:06:28 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9e9a1075-8acb-453a-af88-dc5da7d08e26 tempest-VolumesExtendTest-1190182638 None] Lock "cinder-f3d657e8-7de9-4f15-87f0-0b868cedd660-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Flow 'volume_create_manager' (a2b95824-d2f5-4e16-850d-00c5a78eee15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df990030-f613-4025-98ac-a6bbbebbe7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df990030-f613-4025-98ac-a6bbbebbe7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1484520276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ae78fc-1057-4265-8d98-583ad1ea029e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ffce065594495496136bf9652b3314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:06:29Z,use_quota=True,user_id='b46cab7384f94c8489f8289dce0ea676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba32f04d-cc3b-492b-96ee-595977d7e2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba32f04d-cc3b-492b-96ee-595977d7e2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1857196-a0b5-44cd-96a6-4b11aadeeefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1857196-a0b5-44cd-96a6-4b11aadeeefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8ae78fc-1057-4265-8d98-583ad1ea029e', 'volume_name': 'volume-a8ae78fc-1057-4265-8d98-583ad1ea029e', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed1c1ad-9fb0-4584-afe1-984bedccfc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed1c1ad-9fb0-4584-afe1-984bedccfc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5575f86-0857-41d2-a442-6af860c3f66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:29 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Volume a8ae78fc-1057-4265-8d98-583ad1ea029e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8ae78fc-1057-4265-8d98-583ad1ea029e', 'volume_size': 1}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1484520276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ae78fc-1057-4265-8d98-583ad1ea029e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ffce065594495496136bf9652b3314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:06:29Z,use_quota=True,user_id='b46cab7384f94c8489f8289dce0ea676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Creating volume a8ae78fc-1057-4265-8d98-583ad1ea029e {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:06:29 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:06:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:29 devstack sudo[92522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e 1073741824
Jun 06 01:06:29 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:30 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e 1073741824" returned: 0 in 0.894s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:30 devstack sudo[92528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e
Jun 06 01:06:30 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:31 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e" returned: 0 in 1.570s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] <== create_volume: return (2520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:06:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.523s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5575f86-0857-41d2-a442-6af860c3f66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ae78fc-1057-4265-8d98-583ad1ea029e', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb81bed-43b8-435a-a578-5bf632ecbb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:31 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Volume volume-a8ae78fc-1057-4265-8d98-583ad1ea029e (a8ae78fc-1057-4265-8d98-583ad1ea029e): created successfully
Jun 06 01:06:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb81bed-43b8-435a-a578-5bf632ecbb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Flow 'volume_create_manager' (a2b95824-d2f5-4e16-850d-00c5a78eee15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:06:31 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-3a1245a6-f1dd-4a00-bacf-4bb2244dca4d tempest-VolumesExtendTest-1190182638 None] Created volume successfully.
Jun 06 01:06:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] Creating offline snapshot d0b55ca9-2f04-4d74-8815-68eb0e302493 of volume a8ae78fc-1057-4265-8d98-583ad1ea029e {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:06:32 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c26c689-246a-4303-b355-746e22922e29]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:06:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:33 devstack sudo[92621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e
Jun 06 01:06:33 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:34 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e" returned: 0 in 1.658s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:34 devstack sudo[92636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493 1G
Jun 06 01:06:34 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:34 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:06:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Flow 'volume_create_manager' (c327ebfb-583e-478d-be74-6ec7af7bb3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:06:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5a1cf9-bf80-4e95-a7c4-f37c798b637e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5a1cf9-bf80-4e95-a7c4-f37c798b637e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1650266405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b6d5ec-2c7f-469e-a0ca-694dee723565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765b051a48a745aead8c82a1177267fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:06:35Z,use_quota=True,user_id='560b0c4890cb42248c93bdf7c7ed23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18228f02-1525-46b6-ba72-4a79cae6de1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18228f02-1525-46b6-ba72-4a79cae6de1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b343c3-89ab-4051-a686-2cb2c1170175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b343c3-89ab-4051-a686-2cb2c1170175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b6d5ec-2c7f-469e-a0ca-694dee723565', 'volume_name': 'volume-89b6d5ec-2c7f-469e-a0ca-694dee723565', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45472d4-1609-4396-a461-402f39731497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45472d4-1609-4396-a461-402f39731497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a13889-385a-465a-88f4-d67b29221e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:35 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Volume 89b6d5ec-2c7f-469e-a0ca-694dee723565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b6d5ec-2c7f-469e-a0ca-694dee723565', 'volume_size': 1}
Jun 06 01:06:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:35 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493 1G" returned: 0 in 1.105s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8ae78fc-1057-4265-8d98-583ad1ea029e -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:35 devstack sudo[92643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8ae78fc-1057-4265-8d98-583ad1ea029e -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493
Jun 06 01:06:35 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:36 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8ae78fc-1057-4265-8d98-583ad1ea029e -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493" returned: 0 in 0.719s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:36 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493 is being set with open permissions: ugo+rw
Jun 06 01:06:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:36 devstack sudo[92648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493
Jun 06 01:06:36 devstack sudo[92648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:37 devstack sudo[92648]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493" returned: 0 in 0.665s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:37 devstack sudo[92651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.info
Jun 06 01:06:37 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:37 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.info" returned: 0 in 0.673s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:37 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.info is being set with open permissions: ugo+rw
Jun 06 01:06:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:37 devstack sudo[92654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.info
Jun 06 01:06:37 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:38 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.info" returned: 0 in 0.647s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.597s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.510s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1650266405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b6d5ec-2c7f-469e-a0ca-694dee723565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765b051a48a745aead8c82a1177267fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:06:35Z,use_quota=True,user_id='560b0c4890cb42248c93bdf7c7ed23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:06:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Creating volume 89b6d5ec-2c7f-469e-a0ca-694dee723565 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:06:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:06:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:06:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:06:38 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:06:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-89b6d5ec-2c7f-469e-a0ca-694dee723565 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:38 devstack sudo[92657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-89b6d5ec-2c7f-469e-a0ca-694dee723565 1073741824
Jun 06 01:06:38 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:38 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-a23ffc88-7f5a-4c1f-a7aa-aa0fbe017f0d tempest-VolumesExtendTest-1190182638 None] Create snapshot completed successfully
Jun 06 01:06:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c9bea44a-665e-494f-8a22-c1269de86269 tempest-VolumesExtendTest-1190182638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:39 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-89b6d5ec-2c7f-469e-a0ca-694dee723565 1073741824" returned: 0 in 0.974s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-89b6d5ec-2c7f-469e-a0ca-694dee723565 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:39 devstack sudo[92664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-89b6d5ec-2c7f-469e-a0ca-694dee723565
Jun 06 01:06:39 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:40 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-89b6d5ec-2c7f-469e-a0ca-694dee723565" returned: 0 in 0.756s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:06:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c9bea44a-665e-494f-8a22-c1269de86269 tempest-VolumesExtendTest-1190182638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.899s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a13889-385a-465a-88f4-d67b29221e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b6d5ec-2c7f-469e-a0ca-694dee723565', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8dc7b4-e234-403b-a3cf-31adef7f7d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:40 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2e0705-be70-457f-97a0-89e44156899b]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:06:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c9bea44a-665e-494f-8a22-c1269de86269 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:40 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Volume volume-89b6d5ec-2c7f-469e-a0ca-694dee723565 (89b6d5ec-2c7f-469e-a0ca-694dee723565): created successfully
Jun 06 01:06:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8dc7b4-e234-403b-a3cf-31adef7f7d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Flow 'volume_create_manager' (c327ebfb-583e-478d-be74-6ec7af7bb3e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:06:40 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-2d835410-97be-4017-a023-15ea11d70d2e tempest-VolumesActionsTest-1548534014 None] Created volume successfully.
Jun 06 01:06:40 devstack sudo[92679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e
Jun 06 01:06:40 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:41 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c9bea44a-665e-494f-8a22-c1269de86269 tempest-VolumesExtendTest-1190182638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e" returned: 0 in 0.835s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c9bea44a-665e-494f-8a22-c1269de86269 tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493 2G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-40dfdb64-31e7-47e0-9757-f6a4ae5b28e2 tempest-VolumesActionsTest-1548534014 None] Acquiring lock "cinder-89b6d5ec-2c7f-469e-a0ca-694dee723565" by "attach_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:06:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-40dfdb64-31e7-47e0-9757-f6a4ae5b28e2 tempest-VolumesActionsTest-1548534014 None] Lock "cinder-89b6d5ec-2c7f-469e-a0ca-694dee723565" acquired by "attach_volume" :: waited 0.038s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:06:41 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=48,cinder:INSERT=23,cinder:UPDATE=52,cinder:DELETE=5 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:06:41 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=53,cinder:UPDATE=52,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:06:41 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-40dfdb64-31e7-47e0-9757-f6a4ae5b28e2 tempest-VolumesActionsTest-1548534014 None] Attaching volume 89b6d5ec-2c7f-469e-a0ca-694dee723565 to instance 3b3a763d-6fe5-47c2-be1b-0002a41b223b at mountpoint /dev/vdb on host None.
Jun 06 01:06:41 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-40dfdb64-31e7-47e0-9757-f6a4ae5b28e2 tempest-VolumesActionsTest-1548534014 None] Attach volume completed successfully.
Jun 06 01:06:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-40dfdb64-31e7-47e0-9757-f6a4ae5b28e2 tempest-VolumesActionsTest-1548534014 None] Lock "cinder-89b6d5ec-2c7f-469e-a0ca-694dee723565" released by "attach_volume" :: held 0.231s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:06:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c9bea44a-665e-494f-8a22-c1269de86269 tempest-VolumesExtendTest-1190182638 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493 2G" returned: 0 in 0.425s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c9bea44a-665e-494f-8a22-c1269de86269 tempest-VolumesExtendTest-1190182638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.336s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:41 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c9bea44a-665e-494f-8a22-c1269de86269 tempest-VolumesExtendTest-1190182638 None] Extend volume completed successfully.
Jun 06 01:06:43 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-daa785fe-f22f-4143-ac96-68a7d3515e70 tempest-VolumesActionsTest-1127766802 None] Terminate volume connection completed successfully.
Jun 06 01:06:43 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] Acquiring lock "cinder-d0b55ca9-2f04-4d74-8815-68eb0e302493-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:06:43 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] Lock "cinder-d0b55ca9-2f04-4d74-8815-68eb0e302493-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:06:43 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] Acquiring lock "cinder-quobyte-a8ae78fc-1057-4265-8d98-583ad1ea029e" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:06:43 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] Lock "cinder-quobyte-a8ae78fc-1057-4265-8d98-583ad1ea029e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:06:43 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] Acquiring lock "cinder-quobyte-d0b55ca9-2f04-4d74-8815-68eb0e302493" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:06:43 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] Lock "cinder-quobyte-d0b55ca9-2f04-4d74-8815-68eb0e302493" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:06:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] Deleting offline snapshot d0b55ca9-2f04-4d74-8815-68eb0e302493 of volume a8ae78fc-1057-4265-8d98-583ad1ea029e {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:06:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] snapshot_file for this snap is: volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:06:43 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[546098a7-fd06-4776-ae45-5bb72d369866]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:06:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:43 devstack sudo[92694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493
Jun 06 01:06:43 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:43 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-daa785fe-f22f-4143-ac96-68a7d3515e70 tempest-VolumesActionsTest-1127766802 None] Acquiring lock "cinder-89b6d5ec-2c7f-469e-a0ca-694dee723565-detach_volume" by "detach_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:06:43 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-daa785fe-f22f-4143-ac96-68a7d3515e70 tempest-VolumesActionsTest-1127766802 None] Lock "cinder-89b6d5ec-2c7f-469e-a0ca-694dee723565-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:06:43 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-daa785fe-f22f-4143-ac96-68a7d3515e70 tempest-VolumesActionsTest-1127766802 None] Detaching volume 89b6d5ec-2c7f-469e-a0ca-694dee723565 from instance 3b3a763d-6fe5-47c2-be1b-0002a41b223b.
Jun 06 01:06:43 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-daa785fe-f22f-4143-ac96-68a7d3515e70 tempest-VolumesActionsTest-1127766802 None] Detach volume completed successfully.
Jun 06 01:06:43 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-daa785fe-f22f-4143-ac96-68a7d3515e70 tempest-VolumesActionsTest-1127766802 None] Lock "cinder-89b6d5ec-2c7f-469e-a0ca-694dee723565-detach_volume" released by "detach_volume" :: held 0.195s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:06:44 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c5c2bc8a-1df3-4b91-864b-afaa1d8c17d9 tempest-VolumesActionsTest-1548534014 None] Acquiring lock "cinder-89b6d5ec-2c7f-469e-a0ca-694dee723565-detach_volume" by "detach_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:06:44 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c5c2bc8a-1df3-4b91-864b-afaa1d8c17d9 tempest-VolumesActionsTest-1548534014 None] Lock "cinder-89b6d5ec-2c7f-469e-a0ca-694dee723565-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:06:44 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c5c2bc8a-1df3-4b91-864b-afaa1d8c17d9 tempest-VolumesActionsTest-1548534014 None] Volume detach called, but volume not attached.
Jun 06 01:06:44 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493" returned: 0 in 1.226s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8ae78fc-1057-4265-8d98-583ad1ea029e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:06:44 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c5c2bc8a-1df3-4b91-864b-afaa1d8c17d9 tempest-VolumesActionsTest-1548534014 None] Lock "cinder-89b6d5ec-2c7f-469e-a0ca-694dee723565-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:06:44 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09217f3-9908-405c-ac66-724a8c9aca86]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:06:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:44 devstack sudo[92699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e
Jun 06 01:06:44 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:45 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] Acquiring lock "cinder-89b6d5ec-2c7f-469e-a0ca-694dee723565-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:06:45 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] Lock "cinder-89b6d5ec-2c7f-469e-a0ca-694dee723565-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:06:45 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] Acquiring lock "cinder-quobyte-89b6d5ec-2c7f-469e-a0ca-694dee723565" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:06:45 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] Lock "cinder-quobyte-89b6d5ec-2c7f-469e-a0ca-694dee723565" acquired by "delete_volume" :: waited 0.038s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:06:45 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fee2f8-73f8-4eff-abb0-5961ead5b70e]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:06:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-89b6d5ec-2c7f-469e-a0ca-694dee723565 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:45 devstack sudo[92721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-89b6d5ec-2c7f-469e-a0ca-694dee723565
Jun 06 01:06:45 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:45 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e" returned: 0 in 1.389s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:45 devstack sudo[92727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493
Jun 06 01:06:45 devstack sudo[92727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:46 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-89b6d5ec-2c7f-469e-a0ca-694dee723565" returned: 0 in 1.046s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-89b6d5ec-2c7f-469e-a0ca-694dee723565 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:46 devstack sudo[92732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-89b6d5ec-2c7f-469e-a0ca-694dee723565
Jun 06 01:06:46 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:46 devstack sudo[92727]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493" returned: 0 in 1.044s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:46 devstack sudo[92738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493
Jun 06 01:06:46 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:47 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-89b6d5ec-2c7f-469e-a0ca-694dee723565" returned: 0 in 0.694s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:47 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] Lock "cinder-quobyte-89b6d5ec-2c7f-469e-a0ca-694dee723565" released by "delete_volume" :: held 1.810s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:06:47 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] Created reservations ['dc14f447-32f5-44f0-8810-576aeb91367a', '780a8414-bb49-4089-8454-fd7d07382287', 'd10c5205-b0ed-450e-bdf2-1f340f2c03d6', '9b6930fa-4603-4e41-b279-7546969bff9a'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:06:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:06:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:06:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:47 devstack sudo[92744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:06:47 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:47 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-ee80b4d9-7e08-455e-9a58-2e81512c2784 req-08686e56-a0bb-4d4d-b829-e3ef1abb431b tempest-AttachVolumeShelveTestJSON-2132915721 None] Terminate volume connection completed successfully.
Jun 06 01:06:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-ee80b4d9-7e08-455e-9a58-2e81512c2784 req-08686e56-a0bb-4d4d-b829-e3ef1abb431b tempest-AttachVolumeShelveTestJSON-2132915721 None] Deleting attachment 15c5bfd5-337f-487c-bdaf-83111564ca2c. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:06:47 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e.d0b55ca9-2f04-4d74-8815-68eb0e302493" returned: 0 in 0.729s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:47 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] Lock "cinder-quobyte-d0b55ca9-2f04-4d74-8815-68eb0e302493" released by "_delete_snapshot" :: held 4.555s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:06:47 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] Lock "cinder-quobyte-a8ae78fc-1057-4265-8d98-583ad1ea029e" released by "delete_snapshot" :: held 4.594s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:06:47 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] Created reservations ['713ba01a-4c14-4b6a-abf5-6eba8fd50218', 'c540adc1-18e4-483a-87be-946d583b08c3', '329fb4b5-b101-451f-9994-13daa2486ce3', '40768e32-75d5-48d7-bf27-cf88a376a70f'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:06:47 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] Delete snapshot completed successfully.
Jun 06 01:06:47 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d08ddd82-7147-49ef-998c-19680820fd0f tempest-VolumesExtendTest-1190182638 None] Lock "cinder-d0b55ca9-2f04-4d74-8815-68eb0e302493-delete_snapshot" released by "delete_snapshot" :: held 4.743s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:06:48 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.636s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:48 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:06:48 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] Deleted volume successfully.
Jun 06 01:06:48 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5198ee3c-ecc1-4661-addc-cd0a412aefb8 tempest-VolumesActionsTest-1548534014 None] Lock "cinder-89b6d5ec-2c7f-469e-a0ca-694dee723565-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:06:48 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] Acquiring lock "cinder-a8ae78fc-1057-4265-8d98-583ad1ea029e-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:06:48 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] Lock "cinder-a8ae78fc-1057-4265-8d98-583ad1ea029e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:06:48 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] Acquiring lock "cinder-quobyte-a8ae78fc-1057-4265-8d98-583ad1ea029e" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:06:48 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] Lock "cinder-quobyte-a8ae78fc-1057-4265-8d98-583ad1ea029e" acquired by "delete_volume" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:06:48 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d99ea2-2b24-4537-bf2e-48f7ec30732c]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:06:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:48 devstack sudo[92752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e
Jun 06 01:06:48 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:50 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e" returned: 0 in 1.330s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:50 devstack sudo[92798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e
Jun 06 01:06:50 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:50 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8ae78fc-1057-4265-8d98-583ad1ea029e" returned: 0 in 0.691s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:50 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] Lock "cinder-quobyte-a8ae78fc-1057-4265-8d98-583ad1ea029e" released by "delete_volume" :: held 2.095s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:06:50 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] Created reservations ['26969053-5182-483f-a5e2-11de87499275', '77fbfd52-75c7-4704-b90a-0dd98e95be74', '09637d73-7bc8-4326-b572-a5370ded0023', 'bd3a279b-925f-4ac6-b383-1f876104532b'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:06:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:06:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:06:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:51 devstack sudo[92804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:06:51 devstack sudo[92804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:51 devstack sudo[92804]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.885s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:51 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:06:51 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] Deleted volume successfully.
Jun 06 01:06:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-51297393-8e3e-4281-a05e-c6370ded894e tempest-VolumesExtendTest-1190182638 None] Lock "cinder-a8ae78fc-1057-4265-8d98-583ad1ea029e-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Flow 'volume_create_manager' (f305c9f5-b7d7-4257-9498-8355f0bc0e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50678ef-ca1d-4077-a631-430d28c316e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50678ef-ca1d-4077-a631-430d28c316e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-949868168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323c0dc7-4819-43c1-a16f-d88270892700,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='16b0a73e37c2472bb26954b28b535939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:06:58Z,use_quota=True,user_id='f195c8ba24b54755a15ee67db524000d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01fe5e9-080d-4343-a3af-b11c1b74565e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01fe5e9-080d-4343-a3af-b11c1b74565e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba0b7c1-1cca-4834-a7a4-cf2062b72103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba0b7c1-1cca-4834-a7a4-cf2062b72103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '323c0dc7-4819-43c1-a16f-d88270892700', 'volume_name': 'volume-323c0dc7-4819-43c1-a16f-d88270892700', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8439420-e990-49c5-8b69-c6b955b36f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8439420-e990-49c5-8b69-c6b955b36f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cdb0f03-66ab-42a5-b007-cdbfaf9c0dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:58 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Volume 323c0dc7-4819-43c1-a16f-d88270892700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-323c0dc7-4819-43c1-a16f-d88270892700', 'volume_size': 1}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-949868168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323c0dc7-4819-43c1-a16f-d88270892700,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='16b0a73e37c2472bb26954b28b535939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:06:58Z,use_quota=True,user_id='f195c8ba24b54755a15ee67db524000d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Creating volume 323c0dc7-4819-43c1-a16f-d88270892700 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:06:58 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:06:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-323c0dc7-4819-43c1-a16f-d88270892700 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:58 devstack sudo[92868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-323c0dc7-4819-43c1-a16f-d88270892700 1073741824
Jun 06 01:06:58 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Flow 'volume_create_manager' (979315ac-546f-4213-a6ae-1772e48d1314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8ded02-6f84-4c09-b9e4-e292d32278c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8ded02-6f84-4c09-b9e4-e292d32278c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1792391864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc17f1f6-5c71-48fd-8428-db0838d104ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765b051a48a745aead8c82a1177267fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:06:59Z,use_quota=True,user_id='560b0c4890cb42248c93bdf7c7ed23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3d3c42-f39e-468c-97dd-0ee5f04810cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3d3c42-f39e-468c-97dd-0ee5f04810cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a818440c-0f18-40e7-a5cb-bc6eb110b404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a818440c-0f18-40e7-a5cb-bc6eb110b404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc17f1f6-5c71-48fd-8428-db0838d104ac', 'volume_name': 'volume-dc17f1f6-5c71-48fd-8428-db0838d104ac', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2ab9a5-8c1b-4d1a-b998-ce4202af1ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2ab9a5-8c1b-4d1a-b998-ce4202af1ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa5dee4-b06b-4647-b45a-64d463c1b481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:06:59 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Volume dc17f1f6-5c71-48fd-8428-db0838d104ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc17f1f6-5c71-48fd-8428-db0838d104ac', 'volume_size': 1}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:59 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-323c0dc7-4819-43c1-a16f-d88270892700 1073741824" returned: 0 in 1.101s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-323c0dc7-4819-43c1-a16f-d88270892700 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:59 devstack sudo[92892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-323c0dc7-4819-43c1-a16f-d88270892700
Jun 06 01:06:59 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:59 devstack sudo[92894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:06:59 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:06:59 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-323c0dc7-4819-43c1-a16f-d88270892700" returned: 0 in 0.708s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.782s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1792391864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc17f1f6-5c71-48fd-8428-db0838d104ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765b051a48a745aead8c82a1177267fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:06:59Z,use_quota=True,user_id='560b0c4890cb42248c93bdf7c7ed23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Creating volume dc17f1f6-5c71-48fd-8428-db0838d104ac {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:06:59 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:06:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dc17f1f6-5c71-48fd-8428-db0838d104ac 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:06:59 devstack sudo[92902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dc17f1f6-5c71-48fd-8428-db0838d104ac 1073741824
Jun 06 01:06:59 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cdb0f03-66ab-42a5-b007-cdbfaf9c0dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-323c0dc7-4819-43c1-a16f-d88270892700', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c90aee-9032-4795-a3aa-1ec86896463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:00 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Volume volume-323c0dc7-4819-43c1-a16f-d88270892700 (323c0dc7-4819-43c1-a16f-d88270892700): created successfully
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c90aee-9032-4795-a3aa-1ec86896463a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Flow 'volume_create_manager' (f305c9f5-b7d7-4257-9498-8355f0bc0e37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:00 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:00 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-06bf097a-0e0b-43f6-80d0-211c8d35e079 tempest-VolumesListTestJSON-436312677 None] Created volume successfully.
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.777s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Flow 'volume_create_manager' (f569a85f-8bd3-409b-87b4-725ea11c972a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5fa20f-2ffd-409f-8673-dbd6955328d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5fa20f-2ffd-409f-8673-dbd6955328d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-319976713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2397b7e2-9ae6-4404-bcf6-efe5f4a53984,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='16b0a73e37c2472bb26954b28b535939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:01Z,use_quota=True,user_id='f195c8ba24b54755a15ee67db524000d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e1b5e9-941d-4aeb-8ccb-171d87ba28a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e1b5e9-941d-4aeb-8ccb-171d87ba28a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683c3d7e-62cf-4bb1-b840-9920cc61ee76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683c3d7e-62cf-4bb1-b840-9920cc61ee76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2397b7e2-9ae6-4404-bcf6-efe5f4a53984', 'volume_name': 'volume-2397b7e2-9ae6-4404-bcf6-efe5f4a53984', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264c6f5e-fad3-4821-bca6-06d5e553babe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264c6f5e-fad3-4821-bca6-06d5e553babe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffdc138f-284a-4d6c-8cf7-e0a08e0e9521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:00 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Volume 2397b7e2-9ae6-4404-bcf6-efe5f4a53984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2397b7e2-9ae6-4404-bcf6-efe5f4a53984', 'volume_size': 1}
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:00 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dc17f1f6-5c71-48fd-8428-db0838d104ac 1073741824" returned: 0 in 0.998s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dc17f1f6-5c71-48fd-8428-db0838d104ac {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:01 devstack sudo[92909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dc17f1f6-5c71-48fd-8428-db0838d104ac
Jun 06 01:07:01 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:02 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dc17f1f6-5c71-48fd-8428-db0838d104ac" returned: 0 in 1.009s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:02 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:07:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.133s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:02 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-319976713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2397b7e2-9ae6-4404-bcf6-efe5f4a53984,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='16b0a73e37c2472bb26954b28b535939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:01Z,use_quota=True,user_id='f195c8ba24b54755a15ee67db524000d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:07:02 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Creating volume 2397b7e2-9ae6-4404-bcf6-efe5f4a53984 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:07:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:02 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:02 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:02 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:07:02 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:07:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2397b7e2-9ae6-4404-bcf6-efe5f4a53984 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa5dee4-b06b-4647-b45a-64d463c1b481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc17f1f6-5c71-48fd-8428-db0838d104ac', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c18b42-1be1-4136-ab56-79c3534061d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:02 devstack sudo[92972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2397b7e2-9ae6-4404-bcf6-efe5f4a53984 1073741824
Jun 06 01:07:02 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:02 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Volume volume-dc17f1f6-5c71-48fd-8428-db0838d104ac (dc17f1f6-5c71-48fd-8428-db0838d104ac): created successfully
Jun 06 01:07:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c18b42-1be1-4136-ab56-79c3534061d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Flow 'volume_create_manager' (979315ac-546f-4213-a6ae-1772e48d1314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:02 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-9c46501b-0024-46ff-8807-ea87704f91cd tempest-VolumesActionsTest-1548534014 None] Created volume successfully.
Jun 06 01:07:03 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2397b7e2-9ae6-4404-bcf6-efe5f4a53984 1073741824" returned: 0 in 1.001s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2397b7e2-9ae6-4404-bcf6-efe5f4a53984 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:03 devstack sudo[92989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2397b7e2-9ae6-4404-bcf6-efe5f4a53984
Jun 06 01:07:03 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] Acquiring lock "cinder-dc17f1f6-5c71-48fd-8428-db0838d104ac-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] Lock "cinder-dc17f1f6-5c71-48fd-8428-db0838d104ac-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] Acquiring lock "cinder-quobyte-dc17f1f6-5c71-48fd-8428-db0838d104ac" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] Lock "cinder-quobyte-dc17f1f6-5c71-48fd-8428-db0838d104ac" acquired by "delete_volume" :: waited 0.096s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:04 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcea969-457d-4e30-aab9-edd6cf6268f8]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:07:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dc17f1f6-5c71-48fd-8428-db0838d104ac {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:04 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2397b7e2-9ae6-4404-bcf6-efe5f4a53984" returned: 0 in 1.357s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] <== create_volume: return (2448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:07:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.458s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffdc138f-284a-4d6c-8cf7-e0a08e0e9521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2397b7e2-9ae6-4404-bcf6-efe5f4a53984', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:04 devstack sudo[93011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dc17f1f6-5c71-48fd-8428-db0838d104ac
Jun 06 01:07:04 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40bd39f-c029-4b97-a1a2-9a19d2948881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:04 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Volume volume-2397b7e2-9ae6-4404-bcf6-efe5f4a53984 (2397b7e2-9ae6-4404-bcf6-efe5f4a53984): created successfully
Jun 06 01:07:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40bd39f-c029-4b97-a1a2-9a19d2948881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Flow 'volume_create_manager' (f569a85f-8bd3-409b-87b4-725ea11c972a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:04 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-208ecf7e-5cb9-4635-8cf5-9792008980db tempest-VolumesListTestJSON-436312677 None] Created volume successfully.
Jun 06 01:07:05 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dc17f1f6-5c71-48fd-8428-db0838d104ac" returned: 0 in 1.417s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dc17f1f6-5c71-48fd-8428-db0838d104ac {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:05 devstack sudo[93069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dc17f1f6-5c71-48fd-8428-db0838d104ac
Jun 06 01:07:05 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Flow 'volume_create_manager' (abe8ef4c-9427-4911-a96d-abe2ae768af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc550305-77db-4a87-8a2f-050d4f19e864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc550305-77db-4a87-8a2f-050d4f19e864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-328332560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751269b8-6749-4d0f-8cc7-f20ae886354b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='16b0a73e37c2472bb26954b28b535939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:06Z,use_quota=True,user_id='f195c8ba24b54755a15ee67db524000d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4849cb-2d99-4037-8a31-168ef3980842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4849cb-2d99-4037-8a31-168ef3980842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3f90e2-52b3-49e2-89b1-ece8af220b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3f90e2-52b3-49e2-89b1-ece8af220b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '751269b8-6749-4d0f-8cc7-f20ae886354b', 'volume_name': 'volume-751269b8-6749-4d0f-8cc7-f20ae886354b', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:06 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3961c5a5-bbc4-4198-9092-dd6b8e8a0ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3961c5a5-bbc4-4198-9092-dd6b8e8a0ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e0d51c-7fc6-4e1a-83cf-8b4f3df330b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:06 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Volume 751269b8-6749-4d0f-8cc7-f20ae886354b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-751269b8-6749-4d0f-8cc7-f20ae886354b', 'volume_size': 1}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-328332560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751269b8-6749-4d0f-8cc7-f20ae886354b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='16b0a73e37c2472bb26954b28b535939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:06Z,use_quota=True,user_id='f195c8ba24b54755a15ee67db524000d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Creating volume 751269b8-6749-4d0f-8cc7-f20ae886354b {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:07:06 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-751269b8-6749-4d0f-8cc7-f20ae886354b 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dc17f1f6-5c71-48fd-8428-db0838d104ac" returned: 0 in 1.263s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] Lock "cinder-quobyte-dc17f1f6-5c71-48fd-8428-db0838d104ac" released by "delete_volume" :: held 2.858s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:06 devstack sudo[93078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-751269b8-6749-4d0f-8cc7-f20ae886354b 1073741824
Jun 06 01:07:06 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] Created reservations ['38c1e152-d01b-4a4a-b965-719ab7756ff8', 'bca46dc6-2948-497f-8d5a-975be009c123', 'ff188f54-f0db-4457-8bfb-7f32f872f7d0', 'ae8690d6-35d2-4a9d-8c5c-4d14dea82d71'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:06 devstack sudo[93080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:07:06 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:07 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.041s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:07 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:07:07 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] Deleted volume successfully.
Jun 06 01:07:07 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3e13520d-97ec-4eb6-91c2-cca32ccacb22 tempest-VolumesActionsTest-1127766802 None] Lock "cinder-dc17f1f6-5c71-48fd-8428-db0838d104ac-delete_volume" released by "delete_volume" :: held 4.298s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:08 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:07:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Flow 'volume_create_manager' (7d5b6fc3-054c-4856-914c-86005d576b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (509fe434-5625-4ce7-b394-69d45a0a8604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (509fe434-5625-4ce7-b394-69d45a0a8604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-992403650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9398eec2-0ffe-4da8-92ce-54a445232adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765b051a48a745aead8c82a1177267fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:08Z,use_quota=True,user_id='560b0c4890cb42248c93bdf7c7ed23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6529c6-0745-45c8-87ad-8986ec1d7bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6529c6-0745-45c8-87ad-8986ec1d7bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb997f4-b338-40d2-8404-82345e9dedeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb997f4-b338-40d2-8404-82345e9dedeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9398eec2-0ffe-4da8-92ce-54a445232adc', 'volume_name': 'volume-9398eec2-0ffe-4da8-92ce-54a445232adc', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08afd9b-f11d-4490-8390-ad0936d15dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08afd9b-f11d-4490-8390-ad0936d15dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a58dfd8-fab7-432b-8e37-16cac42c3bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:08 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Volume 9398eec2-0ffe-4da8-92ce-54a445232adc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9398eec2-0ffe-4da8-92ce-54a445232adc', 'volume_size': 1}
Jun 06 01:07:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:08 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-751269b8-6749-4d0f-8cc7-f20ae886354b 1073741824" returned: 0 in 1.722s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-751269b8-6749-4d0f-8cc7-f20ae886354b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:08 devstack sudo[93088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-751269b8-6749-4d0f-8cc7-f20ae886354b
Jun 06 01:07:08 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:09 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-751269b8-6749-4d0f-8cc7-f20ae886354b" returned: 0 in 0.898s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] <== create_volume: return (2665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:07:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.669s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.024s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-992403650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9398eec2-0ffe-4da8-92ce-54a445232adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765b051a48a745aead8c82a1177267fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:08Z,use_quota=True,user_id='560b0c4890cb42248c93bdf7c7ed23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:07:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Creating volume 9398eec2-0ffe-4da8-92ce-54a445232adc {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:07:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:07:09 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:07:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9398eec2-0ffe-4da8-92ce-54a445232adc 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:09 devstack sudo[93092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9398eec2-0ffe-4da8-92ce-54a445232adc 1073741824
Jun 06 01:07:09 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e0d51c-7fc6-4e1a-83cf-8b4f3df330b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-751269b8-6749-4d0f-8cc7-f20ae886354b', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19553d40-5633-4936-8bfe-1c20055f7d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:09 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Volume volume-751269b8-6749-4d0f-8cc7-f20ae886354b (751269b8-6749-4d0f-8cc7-f20ae886354b): created successfully
Jun 06 01:07:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19553d40-5633-4936-8bfe-1c20055f7d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Flow 'volume_create_manager' (abe8ef4c-9427-4911-a96d-abe2ae768af8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:09 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b9179ce3-f42b-44e2-b734-b5d058a4aad9 tempest-VolumesListTestJSON-436312677 None] Created volume successfully.
Jun 06 01:07:10 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9398eec2-0ffe-4da8-92ce-54a445232adc 1073741824" returned: 0 in 1.308s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9398eec2-0ffe-4da8-92ce-54a445232adc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:10 devstack sudo[93097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9398eec2-0ffe-4da8-92ce-54a445232adc
Jun 06 01:07:10 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:12 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9398eec2-0ffe-4da8-92ce-54a445232adc" returned: 0 in 1.356s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] <== create_volume: return (2787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:07:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.796s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a58dfd8-fab7-432b-8e37-16cac42c3bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9398eec2-0ffe-4da8-92ce-54a445232adc', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ef631e-97af-47b5-ab29-ef5fa3459fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:12 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Volume volume-9398eec2-0ffe-4da8-92ce-54a445232adc (9398eec2-0ffe-4da8-92ce-54a445232adc): created successfully
Jun 06 01:07:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ef631e-97af-47b5-ab29-ef5fa3459fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Flow 'volume_create_manager' (7d5b6fc3-054c-4856-914c-86005d576b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:12 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-3f037d87-0f7c-4d57-b612-e36d14a5f569 tempest-VolumesActionsTest-1548534014 None] Created volume successfully.
Jun 06 01:07:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] Acquiring lock "cinder-9398eec2-0ffe-4da8-92ce-54a445232adc-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] Lock "cinder-9398eec2-0ffe-4da8-92ce-54a445232adc-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] Acquiring lock "cinder-quobyte-9398eec2-0ffe-4da8-92ce-54a445232adc" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] Lock "cinder-quobyte-9398eec2-0ffe-4da8-92ce-54a445232adc" acquired by "delete_volume" :: waited 0.056s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:13 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd1abe4-0a35-48c5-8522-765db97c5593]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:07:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9398eec2-0ffe-4da8-92ce-54a445232adc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:13 devstack sudo[93111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9398eec2-0ffe-4da8-92ce-54a445232adc
Jun 06 01:07:13 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] Acquiring lock "cinder-751269b8-6749-4d0f-8cc7-f20ae886354b-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] Lock "cinder-751269b8-6749-4d0f-8cc7-f20ae886354b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] Acquiring lock "cinder-quobyte-751269b8-6749-4d0f-8cc7-f20ae886354b" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] Lock "cinder-quobyte-751269b8-6749-4d0f-8cc7-f20ae886354b" acquired by "delete_volume" :: waited 0.077s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:14 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c5fa8e-423b-4c32-90bc-c1ab19e62309]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:07:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-751269b8-6749-4d0f-8cc7-f20ae886354b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:14 devstack sudo[93151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-751269b8-6749-4d0f-8cc7-f20ae886354b
Jun 06 01:07:14 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:15 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9398eec2-0ffe-4da8-92ce-54a445232adc" returned: 0 in 1.699s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9398eec2-0ffe-4da8-92ce-54a445232adc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:15 devstack sudo[93158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9398eec2-0ffe-4da8-92ce-54a445232adc
Jun 06 01:07:15 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:15 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-751269b8-6749-4d0f-8cc7-f20ae886354b" returned: 0 in 1.140s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-751269b8-6749-4d0f-8cc7-f20ae886354b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:15 devstack sudo[93175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-751269b8-6749-4d0f-8cc7-f20ae886354b
Jun 06 01:07:15 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:16 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9398eec2-0ffe-4da8-92ce-54a445232adc" returned: 0 in 0.941s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] Lock "cinder-quobyte-9398eec2-0ffe-4da8-92ce-54a445232adc" released by "delete_volume" :: held 2.773s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] Created reservations ['a1501aa0-9c7b-4e9c-bc55-5b77b92c4ef4', '655ffc86-31a6-4f01-b072-380e28215097', 'af4143dd-a19a-4177-894d-69b3b47a9e1a', 'f265c0f9-f536-4fb4-ae11-951ee7376c65'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:16 devstack sudo[93200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:07:16 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:16 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-751269b8-6749-4d0f-8cc7-f20ae886354b" returned: 0 in 0.800s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] Lock "cinder-quobyte-751269b8-6749-4d0f-8cc7-f20ae886354b" released by "delete_volume" :: held 2.032s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] Created reservations ['9caf41e4-73cc-42d2-a22f-44dcd16c3df9', 'f58cf56a-53a2-4ba3-ae5c-dc483fba8a25', '563913ef-f028-4a36-8116-2179afcc1a01', '23ccb0ef-8f8f-46db-93d3-67c1ca029429'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:16 devstack sudo[93214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:07:16 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:17 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.801s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:07:17 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] Deleted volume successfully.
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f45e1d5e-2271-4600-84d9-cfda0da0fddc tempest-VolumesActionsTest-1127766802 None] Lock "cinder-9398eec2-0ffe-4da8-92ce-54a445232adc-delete_volume" released by "delete_volume" :: held 3.973s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Flow 'volume_create_manager' (f4c37865-a994-4f7a-bdbe-0873bbe18fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9988b435-425b-4db9-b125-3d863e82144e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9988b435-425b-4db9-b125-3d863e82144e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2127613005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f0401d-f2dc-4619-8385-1f585167c383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765b051a48a745aead8c82a1177267fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:17Z,use_quota=True,user_id='560b0c4890cb42248c93bdf7c7ed23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55d73c1-302d-408d-a5ca-304721c012c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55d73c1-302d-408d-a5ca-304721c012c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5009d94f-9dd5-4e81-8750-31460dffc007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5009d94f-9dd5-4e81-8750-31460dffc007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f0401d-f2dc-4619-8385-1f585167c383', 'volume_name': 'volume-a8f0401d-f2dc-4619-8385-1f585167c383', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c36019a-a65a-4dc6-9abe-f133f6f0b0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c36019a-a65a-4dc6-9abe-f133f6f0b0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae68b26-c9f2-45ed-96dc-12ce0e8a43d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:17 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Volume a8f0401d-f2dc-4619-8385-1f585167c383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f0401d-f2dc-4619-8385-1f585167c383', 'volume_size': 1}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2127613005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f0401d-f2dc-4619-8385-1f585167c383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765b051a48a745aead8c82a1177267fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:17Z,use_quota=True,user_id='560b0c4890cb42248c93bdf7c7ed23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Creating volume a8f0401d-f2dc-4619-8385-1f585167c383 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:07:17 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8f0401d-f2dc-4619-8385-1f585167c383 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:17 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.641s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:07:17 devstack sudo[93218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8f0401d-f2dc-4619-8385-1f585167c383 1073741824
Jun 06 01:07:17 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:17 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] Deleted volume successfully.
Jun 06 01:07:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f258e366-af8d-4814-994b-47aded7e2d99 tempest-VolumesListTestJSON-436312677 None] Lock "cinder-751269b8-6749-4d0f-8cc7-f20ae886354b-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:18 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] Acquiring lock "cinder-2397b7e2-9ae6-4404-bcf6-efe5f4a53984-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:18 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] Lock "cinder-2397b7e2-9ae6-4404-bcf6-efe5f4a53984-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:18 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] Acquiring lock "cinder-quobyte-2397b7e2-9ae6-4404-bcf6-efe5f4a53984" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:18 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] Lock "cinder-quobyte-2397b7e2-9ae6-4404-bcf6-efe5f4a53984" acquired by "delete_volume" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:18 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[355d424b-0844-4fc8-8862-c424fb18ec8a]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:07:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2397b7e2-9ae6-4404-bcf6-efe5f4a53984 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:18 devstack sudo[93225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2397b7e2-9ae6-4404-bcf6-efe5f4a53984
Jun 06 01:07:18 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:18 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8f0401d-f2dc-4619-8385-1f585167c383 1073741824" returned: 0 in 0.873s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8f0401d-f2dc-4619-8385-1f585167c383 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:18 devstack sudo[93228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8f0401d-f2dc-4619-8385-1f585167c383
Jun 06 01:07:18 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:18 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2397b7e2-9ae6-4404-bcf6-efe5f4a53984" returned: 0 in 0.764s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2397b7e2-9ae6-4404-bcf6-efe5f4a53984 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:18 devstack sudo[93234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2397b7e2-9ae6-4404-bcf6-efe5f4a53984
Jun 06 01:07:18 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:19 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8f0401d-f2dc-4619-8385-1f585167c383" returned: 0 in 0.631s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:19 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:07:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae68b26-c9f2-45ed-96dc-12ce0e8a43d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f0401d-f2dc-4619-8385-1f585167c383', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e239313e-d5f7-4712-bd8a-c6e4415ea9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:19 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Volume volume-a8f0401d-f2dc-4619-8385-1f585167c383 (a8f0401d-f2dc-4619-8385-1f585167c383): created successfully
Jun 06 01:07:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e239313e-d5f7-4712-bd8a-c6e4415ea9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Flow 'volume_create_manager' (f4c37865-a994-4f7a-bdbe-0873bbe18fb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:19 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-2897ba34-cf30-437b-9d9c-f92f54ac2c29 tempest-VolumesActionsTest-1548534014 None] Created volume successfully.
Jun 06 01:07:19 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2397b7e2-9ae6-4404-bcf6-efe5f4a53984" returned: 0 in 0.732s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] Lock "cinder-quobyte-2397b7e2-9ae6-4404-bcf6-efe5f4a53984" released by "delete_volume" :: held 1.544s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:19 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] Created reservations ['5255353c-57e1-44f2-aff3-f3d70bfd4ec3', '3e27bd1d-bbce-4bdf-a45c-62de0015a233', '6f79ed77-0cf6-452c-8623-e1af71137fd1', 'fdec9872-92c3-425c-8af0-db57bb1e88fe'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:07:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:19 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:19 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:19 devstack sudo[93293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:07:19 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] Acquiring lock "cinder-a8f0401d-f2dc-4619-8385-1f585167c383-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] Lock "cinder-a8f0401d-f2dc-4619-8385-1f585167c383-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] Acquiring lock "cinder-quobyte-a8f0401d-f2dc-4619-8385-1f585167c383" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] Lock "cinder-quobyte-a8f0401d-f2dc-4619-8385-1f585167c383" acquired by "delete_volume" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:20 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47d83e7-c657-4201-90d9-bc15f1f4627b]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:07:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8f0401d-f2dc-4619-8385-1f585167c383 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:20 devstack sudo[93295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8f0401d-f2dc-4619-8385-1f585167c383
Jun 06 01:07:20 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] Acquiring lock "cinder-323c0dc7-4819-43c1-a16f-d88270892700-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] Lock "cinder-323c0dc7-4819-43c1-a16f-d88270892700-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] Acquiring lock "cinder-quobyte-323c0dc7-4819-43c1-a16f-d88270892700" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] Lock "cinder-quobyte-323c0dc7-4819-43c1-a16f-d88270892700" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:20 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[764730b0-bdd3-4adb-a6f5-88576bed5248]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:07:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-323c0dc7-4819-43c1-a16f-d88270892700 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:20 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.815s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:20 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:07:20 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] Deleted volume successfully.
Jun 06 01:07:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0f336859-ac39-4cb6-bfad-562c7e91490a tempest-VolumesListTestJSON-436312677 None] Lock "cinder-2397b7e2-9ae6-4404-bcf6-efe5f4a53984-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:20 devstack sudo[93299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-323c0dc7-4819-43c1-a16f-d88270892700
Jun 06 01:07:20 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:21 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8f0401d-f2dc-4619-8385-1f585167c383" returned: 0 in 1.401s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8f0401d-f2dc-4619-8385-1f585167c383 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:21 devstack sudo[93349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8f0401d-f2dc-4619-8385-1f585167c383
Jun 06 01:07:21 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:22 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-323c0dc7-4819-43c1-a16f-d88270892700" returned: 0 in 1.692s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-323c0dc7-4819-43c1-a16f-d88270892700 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:22 devstack sudo[93369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-323c0dc7-4819-43c1-a16f-d88270892700
Jun 06 01:07:22 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:22 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8f0401d-f2dc-4619-8385-1f585167c383" returned: 0 in 1.378s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] Lock "cinder-quobyte-a8f0401d-f2dc-4619-8385-1f585167c383" released by "delete_volume" :: held 2.842s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:23 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] Created reservations ['2af8b961-3906-4d05-943c-3dc649b31f99', 'f4473ae3-45f7-46fc-aa83-020e15a31d66', 'bfd83a64-230b-4ee3-b231-8af9940fd8b0', '1b7c6142-11a8-4c6b-919f-cc948e499de0'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:07:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:23 devstack sudo[93379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:07:23 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:23 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:07:24 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Flow 'volume_create_manager' (c84db2f8-a31f-4f43-ba93-69266a1de37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb5ebe9-3aa8-45dc-aaa5-09b5f5be199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-323c0dc7-4819-43c1-a16f-d88270892700" returned: 0 in 1.830s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] Lock "cinder-quobyte-323c0dc7-4819-43c1-a16f-d88270892700" released by "delete_volume" :: held 3.588s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb5ebe9-3aa8-45dc-aaa5-09b5f5be199d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-235622721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f48e625-9117-4e3d-925b-28133771aeb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='856ac271da204f34946190044dc08e5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:24Z,use_quota=True,user_id='3b08a94340754ffb82cff167e5cebc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585144eb-ccef-4a98-95ac-b9af46866b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585144eb-ccef-4a98-95ac-b9af46866b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd38f585-85ac-4140-9d32-1ff9023c7fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd38f585-85ac-4140-9d32-1ff9023c7fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f48e625-9117-4e3d-925b-28133771aeb3', 'volume_name': 'volume-4f48e625-9117-4e3d-925b-28133771aeb3', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099ed35a-e721-4fc9-b026-9bee805a9222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099ed35a-e721-4fc9-b026-9bee805a9222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9971345d-5508-4b92-8c24-d7355ce1be30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:24 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Volume 4f48e625-9117-4e3d-925b-28133771aeb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f48e625-9117-4e3d-925b-28133771aeb3', 'volume_size': 1}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-235622721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f48e625-9117-4e3d-925b-28133771aeb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='856ac271da204f34946190044dc08e5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:24Z,use_quota=True,user_id='3b08a94340754ffb82cff167e5cebc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Creating volume 4f48e625-9117-4e3d-925b-28133771aeb3 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:07:24 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4f48e625-9117-4e3d-925b-28133771aeb3 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:24 devstack sudo[93382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4f48e625-9117-4e3d-925b-28133771aeb3 1073741824
Jun 06 01:07:24 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] Created reservations ['388d76da-7b62-4c99-82ef-318ed8ddfcfd', '79a3b7a7-4233-4aae-ae2a-5bdcb0228071', 'b3852e33-31de-4816-9148-df5db863f079', '0768c1fa-0dd6-445c-baee-efefbee98786'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:24 devstack sudo[93384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:07:24 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:25 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 2.409s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:25 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:07:25 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] Deleted volume successfully.
Jun 06 01:07:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ff82c364-9806-4218-a2ea-19bf687c511a tempest-VolumesActionsTest-1127766802 None] Lock "cinder-a8f0401d-f2dc-4619-8385-1f585167c383-delete_volume" released by "delete_volume" :: held 5.759s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:25 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:07:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Flow 'volume_create_manager' (d49fd587-2a46-4b7f-ae60-3e3799ceb602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883a61c8-abf4-4345-90fd-79f32d254b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883a61c8-abf4-4345-90fd-79f32d254b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1409510973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee5c416-53b4-4c6f-843a-098539c60b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765b051a48a745aead8c82a1177267fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:26Z,use_quota=True,user_id='560b0c4890cb42248c93bdf7c7ed23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8ec1fa-0c97-4861-a650-70b170c98825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8ec1fa-0c97-4861-a650-70b170c98825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561d4f9b-8b8f-4de8-971e-5c8a186f3e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561d4f9b-8b8f-4de8-971e-5c8a186f3e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ee5c416-53b4-4c6f-843a-098539c60b38', 'volume_name': 'volume-8ee5c416-53b4-4c6f-843a-098539c60b38', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f6a166-042d-486a-bac0-4e027e1f5f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f6a166-042d-486a-bac0-4e027e1f5f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:26 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c2a111-0f88-49b0-9870-51af144437b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:26 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Volume 8ee5c416-53b4-4c6f-843a-098539c60b38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ee5c416-53b4-4c6f-843a-098539c60b38', 'volume_size': 1}
Jun 06 01:07:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:26 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.815s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:26 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:07:26 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] Deleted volume successfully.
Jun 06 01:07:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2cad5f8e-858d-4298-84e3-9b32354e5e6c tempest-VolumesListTestJSON-436312677 None] Lock "cinder-323c0dc7-4819-43c1-a16f-d88270892700-delete_volume" released by "delete_volume" :: held 6.043s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:26 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4f48e625-9117-4e3d-925b-28133771aeb3 1073741824" returned: 0 in 2.319s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4f48e625-9117-4e3d-925b-28133771aeb3 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:26 devstack sudo[93394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4f48e625-9117-4e3d-925b-28133771aeb3
Jun 06 01:07:26 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:27 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4f48e625-9117-4e3d-925b-28133771aeb3" returned: 0 in 0.819s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] <== create_volume: return (3211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:07:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.214s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.481s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1409510973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee5c416-53b4-4c6f-843a-098539c60b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765b051a48a745aead8c82a1177267fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:26Z,use_quota=True,user_id='560b0c4890cb42248c93bdf7c7ed23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:07:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Creating volume 8ee5c416-53b4-4c6f-843a-098539c60b38 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:07:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:07:27 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:07:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ee5c416-53b4-4c6f-843a-098539c60b38 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9971345d-5508-4b92-8c24-d7355ce1be30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f48e625-9117-4e3d-925b-28133771aeb3', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:27 devstack sudo[93397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ee5c416-53b4-4c6f-843a-098539c60b38 1073741824
Jun 06 01:07:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cce09db-2ae5-4634-90d1-bc1f7294f2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:27 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:27 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Volume volume-4f48e625-9117-4e3d-925b-28133771aeb3 (4f48e625-9117-4e3d-925b-28133771aeb3): created successfully
Jun 06 01:07:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cce09db-2ae5-4634-90d1-bc1f7294f2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Flow 'volume_create_manager' (c84db2f8-a31f-4f43-ba93-69266a1de37e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:27 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-284293a7-e6a4-4841-bb5e-0acdc0759469 tempest-ServerRescueNegativeTestJSON-510640070 None] Created volume successfully.
Jun 06 01:07:29 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ee5c416-53b4-4c6f-843a-098539c60b38 1073741824" returned: 0 in 1.639s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ee5c416-53b4-4c6f-843a-098539c60b38 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:29 devstack sudo[93404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ee5c416-53b4-4c6f-843a-098539c60b38
Jun 06 01:07:29 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:30 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ee5c416-53b4-4c6f-843a-098539c60b38" returned: 0 in 1.312s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] <== create_volume: return (3025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:07:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.035s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c2a111-0f88-49b0-9870-51af144437b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee5c416-53b4-4c6f-843a-098539c60b38', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93adbe5-75c8-4309-88bf-1c1d3beaaaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:30 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Volume volume-8ee5c416-53b4-4c6f-843a-098539c60b38 (8ee5c416-53b4-4c6f-843a-098539c60b38): created successfully
Jun 06 01:07:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93adbe5-75c8-4309-88bf-1c1d3beaaaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Flow 'volume_create_manager' (d49fd587-2a46-4b7f-ae60-3e3799ceb602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:30 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-9f4cb04b-3051-4baa-9808-9faf31df4f40 tempest-VolumesActionsTest-1548534014 None] Created volume successfully.
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] Acquiring lock "cinder-8ee5c416-53b4-4c6f-843a-098539c60b38-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] Lock "cinder-8ee5c416-53b4-4c6f-843a-098539c60b38-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Flow 'volume_create_manager' (2165049b-1f37-409d-9773-3d1f67f8f635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ee3058-ed94-4579-82ef-132fb55475c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] Acquiring lock "cinder-quobyte-8ee5c416-53b4-4c6f-843a-098539c60b38" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ee3058-ed94-4579-82ef-132fb55475c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1220260362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ef8119-1af9-4452-9ac4-7214cb5bd3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b07a2b149a41d3b01c65a38f075c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:32Z,use_quota=True,user_id='9ca8211907614925ad17d79d6f873d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55944f88-6d6d-473f-9547-c016c6d25263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55944f88-6d6d-473f-9547-c016c6d25263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad514fe5-eb5e-4150-9233-d1e0d772736b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad514fe5-eb5e-4150-9233-d1e0d772736b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ef8119-1af9-4452-9ac4-7214cb5bd3bd', 'volume_name': 'volume-70ef8119-1af9-4452-9ac4-7214cb5bd3bd', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77810180-ccd2-4e01-b86e-db084eec78dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77810180-ccd2-4e01-b86e-db084eec78dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4012856-8f6e-42b2-ae08-e4c0f643cdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:31 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Volume 70ef8119-1af9-4452-9ac4-7214cb5bd3bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ef8119-1af9-4452-9ac4-7214cb5bd3bd', 'volume_size': 1}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1220260362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ef8119-1af9-4452-9ac4-7214cb5bd3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b07a2b149a41d3b01c65a38f075c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:32Z,use_quota=True,user_id='9ca8211907614925ad17d79d6f873d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Creating volume 70ef8119-1af9-4452-9ac4-7214cb5bd3bd {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:07:31 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-70ef8119-1af9-4452-9ac4-7214cb5bd3bd 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] Lock "cinder-quobyte-8ee5c416-53b4-4c6f-843a-098539c60b38" acquired by "delete_volume" :: waited 0.086s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:31 devstack sudo[93408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-70ef8119-1af9-4452-9ac4-7214cb5bd3bd 1073741824
Jun 06 01:07:31 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f39d045-6629-403d-ba66-a5d201082dfa]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:07:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ee5c416-53b4-4c6f-843a-098539c60b38 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:32 devstack sudo[93410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ee5c416-53b4-4c6f-843a-098539c60b38
Jun 06 01:07:32 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:32 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-70ef8119-1af9-4452-9ac4-7214cb5bd3bd 1073741824" returned: 0 in 1.048s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-70ef8119-1af9-4452-9ac4-7214cb5bd3bd {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:32 devstack sudo[93420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-70ef8119-1af9-4452-9ac4-7214cb5bd3bd
Jun 06 01:07:32 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:33 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ee5c416-53b4-4c6f-843a-098539c60b38" returned: 0 in 1.164s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ee5c416-53b4-4c6f-843a-098539c60b38 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:33 devstack sudo[93422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ee5c416-53b4-4c6f-843a-098539c60b38
Jun 06 01:07:33 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:34 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-70ef8119-1af9-4452-9ac4-7214cb5bd3bd" returned: 0 in 1.399s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:34 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] <== create_volume: return (2519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:07:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.522s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4012856-8f6e-42b2-ae08-e4c0f643cdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ef8119-1af9-4452-9ac4-7214cb5bd3bd', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302eff9d-ff67-4936-9928-bcc2b44ae4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:34 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Volume volume-70ef8119-1af9-4452-9ac4-7214cb5bd3bd (70ef8119-1af9-4452-9ac4-7214cb5bd3bd): created successfully
Jun 06 01:07:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302eff9d-ff67-4936-9928-bcc2b44ae4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Flow 'volume_create_manager' (2165049b-1f37-409d-9773-3d1f67f8f635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:34 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d82f6591-16ec-4506-956c-14f14cfba093 tempest-VolumesNegativeTest-1296442624 None] Created volume successfully.
Jun 06 01:07:34 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ee5c416-53b4-4c6f-843a-098539c60b38" returned: 0 in 1.441s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:34 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] Lock "cinder-quobyte-8ee5c416-53b4-4c6f-843a-098539c60b38" released by "delete_volume" :: held 2.677s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:34 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] Created reservations ['556b4fa7-0a49-4adc-8675-9b870e3ee4e4', 'e931d93e-7c53-4c50-b009-1551b9e9438f', '448a844c-ab2b-44f1-879e-690bedd6fe0c', '382300fc-3472-4250-bf04-bebd7cf0e47e'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:07:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:34 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:34 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:34 devstack sudo[93458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:07:34 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:35 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.086s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:35 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:07:35 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] Deleted volume successfully.
Jun 06 01:07:35 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6d12433d-4d2e-4edc-8bd7-96643d7d6f23 tempest-VolumesActionsTest-1127766802 None] Lock "cinder-8ee5c416-53b4-4c6f-843a-098539c60b38-delete_volume" released by "delete_volume" :: held 4.194s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Flow 'volume_create_manager' (b2a178bc-ea03-42df-a9c6-bf1d22a537a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4450a6f6-50ef-48ad-a32a-7757b8aff79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4450a6f6-50ef-48ad-a32a-7757b8aff79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1053836221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edea44e3-5552-4b62-bcf2-6e22bb885250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765b051a48a745aead8c82a1177267fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:36Z,use_quota=True,user_id='560b0c4890cb42248c93bdf7c7ed23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30eeadeb-f787-4c1b-98a4-7a17e159a670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30eeadeb-f787-4c1b-98a4-7a17e159a670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6897544e-1e02-4486-942e-719a34dadfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6897544e-1e02-4486-942e-719a34dadfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edea44e3-5552-4b62-bcf2-6e22bb885250', 'volume_name': 'volume-edea44e3-5552-4b62-bcf2-6e22bb885250', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c594611-c1fd-41e7-bd1a-9f79b56e7012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c594611-c1fd-41e7-bd1a-9f79b56e7012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d2b921-3914-4aa9-a4c6-9c28dd00df5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:36 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Volume edea44e3-5552-4b62-bcf2-6e22bb885250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edea44e3-5552-4b62-bcf2-6e22bb885250', 'volume_size': 1}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1053836221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edea44e3-5552-4b62-bcf2-6e22bb885250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765b051a48a745aead8c82a1177267fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:36Z,use_quota=True,user_id='560b0c4890cb42248c93bdf7c7ed23c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Creating volume edea44e3-5552-4b62-bcf2-6e22bb885250 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:07:36 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:07:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-edea44e3-5552-4b62-bcf2-6e22bb885250 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:36 devstack sudo[93478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-edea44e3-5552-4b62-bcf2-6e22bb885250 1073741824
Jun 06 01:07:36 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:37 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-edea44e3-5552-4b62-bcf2-6e22bb885250 1073741824" returned: 0 in 1.070s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-edea44e3-5552-4b62-bcf2-6e22bb885250 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:37 devstack sudo[93516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-edea44e3-5552-4b62-bcf2-6e22bb885250
Jun 06 01:07:37 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:38 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-edea44e3-5552-4b62-bcf2-6e22bb885250" returned: 0 in 0.615s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:07:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d2b921-3914-4aa9-a4c6-9c28dd00df5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edea44e3-5552-4b62-bcf2-6e22bb885250', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0003aae4-ad52-41bf-8831-249888854235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:38 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Volume volume-edea44e3-5552-4b62-bcf2-6e22bb885250 (edea44e3-5552-4b62-bcf2-6e22bb885250): created successfully
Jun 06 01:07:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0003aae4-ad52-41bf-8831-249888854235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Flow 'volume_create_manager' (b2a178bc-ea03-42df-a9c6-bf1d22a537a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:38 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-a0e5d1ae-c72b-4b1d-beba-366b093573cf tempest-VolumesActionsTest-1548534014 None] Created volume successfully.
Jun 06 01:07:38 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] Acquiring lock "cinder-edea44e3-5552-4b62-bcf2-6e22bb885250-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] Lock "cinder-edea44e3-5552-4b62-bcf2-6e22bb885250-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] Acquiring lock "cinder-quobyte-edea44e3-5552-4b62-bcf2-6e22bb885250" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] Lock "cinder-quobyte-edea44e3-5552-4b62-bcf2-6e22bb885250" acquired by "delete_volume" :: waited 0.023s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:39 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad124041-15fb-43c4-9c56-47a220f9b1d4]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:07:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-edea44e3-5552-4b62-bcf2-6e22bb885250 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:39 devstack sudo[93542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-edea44e3-5552-4b62-bcf2-6e22bb885250
Jun 06 01:07:39 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:40 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-edea44e3-5552-4b62-bcf2-6e22bb885250" returned: 0 in 0.939s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-edea44e3-5552-4b62-bcf2-6e22bb885250 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:40 devstack sudo[93586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-edea44e3-5552-4b62-bcf2-6e22bb885250
Jun 06 01:07:40 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:40 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-edea44e3-5552-4b62-bcf2-6e22bb885250" returned: 0 in 0.701s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:40 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] Lock "cinder-quobyte-edea44e3-5552-4b62-bcf2-6e22bb885250" released by "delete_volume" :: held 1.696s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:40 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] Created reservations ['0a3b8f0e-13ab-4656-bdc9-209f571a85d2', '52295ac1-7548-47ba-a06a-e6adde0a5a57', '36c7239c-5845-4615-b5a9-56f77d7f013a', 'cb6a5610-a0d1-4853-874b-c8eb3a836175'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:07:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:41 devstack sudo[93592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:07:41 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:41 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.000s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:41 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:07:42 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] Deleted volume successfully.
Jun 06 01:07:42 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=121,cinder:SELECT=85,cinder:INSERT=22,cinder:DELETE=7 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:07:42 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-37c2a6ff-2285-453c-9ec3-363533b9c67a tempest-VolumesActionsTest-1548534014 None] Lock "cinder-edea44e3-5552-4b62-bcf2-6e22bb885250-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=84,cinder:UPDATE=122,cinder:INSERT=33,cinder:DELETE=13 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Flow 'volume_create_manager' (fb299a02-d9f0-4fc1-a7d6-6265262fd912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820bdf83-06b5-4126-8c2b-49dc02e4033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820bdf83-06b5-4126-8c2b-49dc02e4033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1245255904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3ee914-e929-4320-aba1-71087b9cc38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5be28ee94a34f38b465fb62d53d4c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:50Z,use_quota=True,user_id='02bf1eec8ff84164aae2c3716da1c15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa8f018-99a3-4893-bd98-59626266cb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa8f018-99a3-4893-bd98-59626266cb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368041a6-83a7-4a8f-814b-999d5ad8aabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368041a6-83a7-4a8f-814b-999d5ad8aabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3ee914-e929-4320-aba1-71087b9cc38e', 'volume_name': 'volume-9c3ee914-e929-4320-aba1-71087b9cc38e', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a597a7-eda6-4441-bdc1-db91faa26520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a597a7-eda6-4441-bdc1-db91faa26520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a1775b-1aa2-4fd6-abd9-d6ef356fa3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:50 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Volume 9c3ee914-e929-4320-aba1-71087b9cc38e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3ee914-e929-4320-aba1-71087b9cc38e', 'volume_size': 1}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1245255904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3ee914-e929-4320-aba1-71087b9cc38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5be28ee94a34f38b465fb62d53d4c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:07:50Z,use_quota=True,user_id='02bf1eec8ff84164aae2c3716da1c15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Creating volume 9c3ee914-e929-4320-aba1-71087b9cc38e {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:07:50 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:07:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9c3ee914-e929-4320-aba1-71087b9cc38e 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:50 devstack sudo[93761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9c3ee914-e929-4320-aba1-71087b9cc38e 1073741824
Jun 06 01:07:50 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] Acquiring lock "cinder-4f48e625-9117-4e3d-925b-28133771aeb3-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] Lock "cinder-4f48e625-9117-4e3d-925b-28133771aeb3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] Acquiring lock "cinder-quobyte-4f48e625-9117-4e3d-925b-28133771aeb3" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:07:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] Lock "cinder-quobyte-4f48e625-9117-4e3d-925b-28133771aeb3" acquired by "delete_volume" :: waited 0.040s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:07:51 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2014810-eab6-4a59-ba52-7ac10e18316f]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:07:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4f48e625-9117-4e3d-925b-28133771aeb3 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:52 devstack sudo[93799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4f48e625-9117-4e3d-925b-28133771aeb3
Jun 06 01:07:52 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:52 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9c3ee914-e929-4320-aba1-71087b9cc38e 1073741824" returned: 0 in 2.119s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9c3ee914-e929-4320-aba1-71087b9cc38e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:52 devstack sudo[93811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9c3ee914-e929-4320-aba1-71087b9cc38e
Jun 06 01:07:52 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:53 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4f48e625-9117-4e3d-925b-28133771aeb3" returned: 0 in 1.668s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4f48e625-9117-4e3d-925b-28133771aeb3 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:53 devstack sudo[93817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4f48e625-9117-4e3d-925b-28133771aeb3
Jun 06 01:07:53 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:54 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9c3ee914-e929-4320-aba1-71087b9cc38e" returned: 0 in 1.591s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] <== create_volume: return (3810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:07:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.814s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a1775b-1aa2-4fd6-abd9-d6ef356fa3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3ee914-e929-4320-aba1-71087b9cc38e', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9df73b2-2fff-4202-a039-244dce441758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:07:54 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Volume volume-9c3ee914-e929-4320-aba1-71087b9cc38e (9c3ee914-e929-4320-aba1-71087b9cc38e): created successfully
Jun 06 01:07:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9df73b2-2fff-4202-a039-244dce441758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:07:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Flow 'volume_create_manager' (fb299a02-d9f0-4fc1-a7d6-6265262fd912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:07:54 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-12944e9e-dc7c-431d-baff-0e902e216fd7 tempest-AttachVolumeShelveTestJSON-2132915721 None] Created volume successfully.
Jun 06 01:07:54 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4f48e625-9117-4e3d-925b-28133771aeb3" returned: 0 in 1.428s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:55 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] Lock "cinder-quobyte-4f48e625-9117-4e3d-925b-28133771aeb3" released by "delete_volume" :: held 3.215s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:55 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] Created reservations ['c6866b5d-bcc0-4742-9000-a87c473279e9', 'f54eee6c-9ee9-4aa3-9097-193ca8970694', '77cc644f-d939-4f8c-ae3f-c077ac05ad94', '102ed378-e2eb-46a2-91e4-2d49362f0479'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:07:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:55 devstack sudo[93826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:07:55 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:07:56 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root
Jun 06 01:07:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.480s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:07:56 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:07:56 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] Deleted volume successfully.
Jun 06 01:07:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-df921482-0904-44fd-8580-43f6959fd832 tempest-ServerRescueNegativeTestJSON-510640070 None] Lock "cinder-4f48e625-9117-4e3d-925b-28133771aeb3-delete_volume" released by "delete_volume" :: held 5.210s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:07:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:07:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:07:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:07:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:07:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:07:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:07:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:07:59 devstack sudo[93929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:07:59 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:00 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.176s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Flow 'volume_create_manager' (00a04018-62dc-46e6-b6c7-8bf77c2c4d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff09d099-9961-4fda-90ac-ef0771f2792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff09d099-9961-4fda-90ac-ef0771f2792b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1420208758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd95a462-d8d2-4f08-bf38-c8be81d09a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='042eb8ead0694cb89c9306814eca07b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:04Z,use_quota=True,user_id='be17da9d95be497bbcef06d43cc277c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4de7970-37d1-48c3-81b8-40754e5b94c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4de7970-37d1-48c3-81b8-40754e5b94c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de6bf0b-6b5f-4987-b1de-44076f6f1bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de6bf0b-6b5f-4987-b1de-44076f6f1bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd95a462-d8d2-4f08-bf38-c8be81d09a43', 'volume_name': 'volume-dd95a462-d8d2-4f08-bf38-c8be81d09a43', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28594ece-1dc5-4eac-9ff5-500717e9eaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28594ece-1dc5-4eac-9ff5-500717e9eaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee023d7-42a3-42dc-abb8-0ba5f58767d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:03 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Volume dd95a462-d8d2-4f08-bf38-c8be81d09a43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd95a462-d8d2-4f08-bf38-c8be81d09a43', 'volume_size': 1}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1420208758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd95a462-d8d2-4f08-bf38-c8be81d09a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='042eb8ead0694cb89c9306814eca07b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:04Z,use_quota=True,user_id='be17da9d95be497bbcef06d43cc277c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Creating volume dd95a462-d8d2-4f08-bf38-c8be81d09a43 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:08:03 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:08:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dd95a462-d8d2-4f08-bf38-c8be81d09a43 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:03 devstack sudo[93982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dd95a462-d8d2-4f08-bf38-c8be81d09a43 1073741824
Jun 06 01:08:03 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:05 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dd95a462-d8d2-4f08-bf38-c8be81d09a43 1073741824" returned: 0 in 1.154s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dd95a462-d8d2-4f08-bf38-c8be81d09a43 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:05 devstack sudo[93991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dd95a462-d8d2-4f08-bf38-c8be81d09a43
Jun 06 01:08:05 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:05 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dd95a462-d8d2-4f08-bf38-c8be81d09a43" returned: 0 in 0.799s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:08:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee023d7-42a3-42dc-abb8-0ba5f58767d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd95a462-d8d2-4f08-bf38-c8be81d09a43', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3cb7776-e212-49a7-bd88-19c3974d78d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:05 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Volume volume-dd95a462-d8d2-4f08-bf38-c8be81d09a43 (dd95a462-d8d2-4f08-bf38-c8be81d09a43): created successfully
Jun 06 01:08:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3cb7776-e212-49a7-bd88-19c3974d78d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Flow 'volume_create_manager' (00a04018-62dc-46e6-b6c7-8bf77c2c4d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:05 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-aa0a1006-032f-4388-9c16-dbe9c914f92b tempest-VolumesListAdminTestJSON-821234699 None] Created volume successfully.
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Flow 'volume_create_manager' (34d4e646-2ca0-4250-a363-7e986512c351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4af76e1-240d-4b12-a27b-17dba46dca6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4af76e1-240d-4b12-a27b-17dba46dca6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-561361215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba57317e-65eb-44f2-ae04-e4e2129b3d8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='042eb8ead0694cb89c9306814eca07b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:08Z,use_quota=True,user_id='be17da9d95be497bbcef06d43cc277c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521c2446-1ad8-4e38-be37-61dc6b9c5184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521c2446-1ad8-4e38-be37-61dc6b9c5184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483f1f0d-85d0-4ae4-b5a9-974a775775b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483f1f0d-85d0-4ae4-b5a9-974a775775b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba57317e-65eb-44f2-ae04-e4e2129b3d8b', 'volume_name': 'volume-ba57317e-65eb-44f2-ae04-e4e2129b3d8b', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b595c502-94b8-4cf4-aac4-96f2bc0073d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b595c502-94b8-4cf4-aac4-96f2bc0073d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744cc86e-2ad9-4839-bf50-e4b351295d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:07 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Volume ba57317e-65eb-44f2-ae04-e4e2129b3d8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba57317e-65eb-44f2-ae04-e4e2129b3d8b', 'volume_size': 1}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-561361215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba57317e-65eb-44f2-ae04-e4e2129b3d8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='042eb8ead0694cb89c9306814eca07b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:08Z,use_quota=True,user_id='be17da9d95be497bbcef06d43cc277c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Creating volume ba57317e-65eb-44f2-ae04-e4e2129b3d8b {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:08:07 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:08:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ba57317e-65eb-44f2-ae04-e4e2129b3d8b 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:07 devstack sudo[94088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ba57317e-65eb-44f2-ae04-e4e2129b3d8b 1073741824
Jun 06 01:08:07 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:08 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ba57317e-65eb-44f2-ae04-e4e2129b3d8b 1073741824" returned: 0 in 0.984s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ba57317e-65eb-44f2-ae04-e4e2129b3d8b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:08 devstack sudo[94096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ba57317e-65eb-44f2-ae04-e4e2129b3d8b
Jun 06 01:08:08 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:09 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ba57317e-65eb-44f2-ae04-e4e2129b3d8b" returned: 0 in 0.644s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:08:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744cc86e-2ad9-4839-bf50-e4b351295d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba57317e-65eb-44f2-ae04-e4e2129b3d8b', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50066a2-cfe0-4be5-a576-b2458c1c8212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:09 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Volume volume-ba57317e-65eb-44f2-ae04-e4e2129b3d8b (ba57317e-65eb-44f2-ae04-e4e2129b3d8b): created successfully
Jun 06 01:08:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50066a2-cfe0-4be5-a576-b2458c1c8212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Flow 'volume_create_manager' (34d4e646-2ca0-4250-a363-7e986512c351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:09 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-1b7220de-612f-445f-8528-0b9a3c9d3ebd tempest-VolumesListAdminTestJSON-821234699 None] Created volume successfully.
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Flow 'volume_create_manager' (463841d7-0009-4f95-a297-6b4d653764d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50137fd-ce81-4d0d-bcf8-42fe5ba5d54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50137fd-ce81-4d0d-bcf8-42fe5ba5d54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-540617796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d1cbf3-33f4-4db6-8326-ab8c375ab20d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='042eb8ead0694cb89c9306814eca07b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:10Z,use_quota=True,user_id='be17da9d95be497bbcef06d43cc277c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507fc522-b803-466a-9486-539abbf5aa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507fc522-b803-466a-9486-539abbf5aa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bad138c-8c0e-4cf1-892d-d0a0aa818ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bad138c-8c0e-4cf1-892d-d0a0aa818ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4d1cbf3-33f4-4db6-8326-ab8c375ab20d', 'volume_name': 'volume-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8866331f-377c-463b-81f3-c5a2c46e4f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8866331f-377c-463b-81f3-c5a2c46e4f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f4d7da-7c24-44c2-aa25-4f5f4e20f49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:10 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Volume a4d1cbf3-33f4-4db6-8326-ab8c375ab20d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d', 'volume_size': 1}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-540617796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d1cbf3-33f4-4db6-8326-ab8c375ab20d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='042eb8ead0694cb89c9306814eca07b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:10Z,use_quota=True,user_id='be17da9d95be497bbcef06d43cc277c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Creating volume a4d1cbf3-33f4-4db6-8326-ab8c375ab20d {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:08:10 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:10 devstack sudo[94099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d 1073741824
Jun 06 01:08:10 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] Acquiring lock "cinder-70ef8119-1af9-4452-9ac4-7214cb5bd3bd-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] Lock "cinder-70ef8119-1af9-4452-9ac4-7214cb5bd3bd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] Acquiring lock "cinder-quobyte-70ef8119-1af9-4452-9ac4-7214cb5bd3bd" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] Lock "cinder-quobyte-70ef8119-1af9-4452-9ac4-7214cb5bd3bd" acquired by "delete_volume" :: waited 0.023s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0a6165-08cf-4321-acda-3f08830a479d]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:08:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-70ef8119-1af9-4452-9ac4-7214cb5bd3bd {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:10 devstack sudo[94101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-70ef8119-1af9-4452-9ac4-7214cb5bd3bd
Jun 06 01:08:10 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:11 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d 1073741824" returned: 0 in 0.930s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:11 devstack sudo[94109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d
Jun 06 01:08:11 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:11 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-70ef8119-1af9-4452-9ac4-7214cb5bd3bd" returned: 0 in 0.925s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-70ef8119-1af9-4452-9ac4-7214cb5bd3bd {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:11 devstack sudo[94114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-70ef8119-1af9-4452-9ac4-7214cb5bd3bd
Jun 06 01:08:11 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:12 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d" returned: 0 in 0.755s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:08:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f4d7da-7c24-44c2-aa25-4f5f4e20f49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0350e1ef-4e44-415a-a77d-1bbfa206ce6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:12 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Volume volume-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d (a4d1cbf3-33f4-4db6-8326-ab8c375ab20d): created successfully
Jun 06 01:08:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0350e1ef-4e44-415a-a77d-1bbfa206ce6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Flow 'volume_create_manager' (463841d7-0009-4f95-a297-6b4d653764d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:12 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b3a75c11-c36a-4c53-8ecc-a2e8e36d66f6 tempest-VolumesListAdminTestJSON-821234699 None] Created volume successfully.
Jun 06 01:08:12 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-70ef8119-1af9-4452-9ac4-7214cb5bd3bd" returned: 0 in 0.825s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] Lock "cinder-quobyte-70ef8119-1af9-4452-9ac4-7214cb5bd3bd" released by "delete_volume" :: held 1.797s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:08:12 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] Created reservations ['d5a270d3-873e-49b4-bc7e-b6b09dcd892d', '03be4068-2a0b-41c4-ac34-321fdfe964cd', '8ca59b5f-cd74-41d1-8830-b7f98cfa760e', 'f8bb09a8-2335-4257-9723-33ebdf6a796d'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:08:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:08:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:08:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:12 devstack sudo[94119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:08:12 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Flow 'volume_create_manager' (004cc520-e648-476b-9006-49617c141761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c17aa9d-3618-4cc8-8c55-22d397275fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c17aa9d-3618-4cc8-8c55-22d397275fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb83570-2b29-4a75-8c89-9cad68947d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e25b3cf3e66345a48e7f61b7e877e81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:13Z,use_quota=True,user_id='3566d3014e454fb1bc1eba7c0b26748b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ffbc29-8853-4ca2-bc8a-edf142a60047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ffbc29-8853-4ca2-bc8a-edf142a60047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924b5df0-54bb-4358-8f54-a031954065e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924b5df0-54bb-4358-8f54-a031954065e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bb83570-2b29-4a75-8c89-9cad68947d47', 'volume_name': 'volume-1bb83570-2b29-4a75-8c89-9cad68947d47', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089ffc6c-3cb6-41e6-bb12-5ad3a7606296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089ffc6c-3cb6-41e6-bb12-5ad3a7606296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4255257c-8b6b-4728-9336-29c12f4255ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:13 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Volume 1bb83570-2b29-4a75-8c89-9cad68947d47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bb83570-2b29-4a75-8c89-9cad68947d47', 'volume_size': 1}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb83570-2b29-4a75-8c89-9cad68947d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e25b3cf3e66345a48e7f61b7e877e81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:13Z,use_quota=True,user_id='3566d3014e454fb1bc1eba7c0b26748b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Creating volume 1bb83570-2b29-4a75-8c89-9cad68947d47 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:08:13 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1bb83570-2b29-4a75-8c89-9cad68947d47 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:13 devstack sudo[94122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1bb83570-2b29-4a75-8c89-9cad68947d47 1073741824
Jun 06 01:08:13 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:13 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.739s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:08:13 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] Deleted volume successfully.
Jun 06 01:08:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f9fba9b1-d4fa-4aa2-a38c-fb9e7f3b9d3f tempest-VolumesNegativeTest-1296442624 None] Lock "cinder-70ef8119-1af9-4452-9ac4-7214cb5bd3bd-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:08:14 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1bb83570-2b29-4a75-8c89-9cad68947d47 1073741824" returned: 0 in 0.947s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1bb83570-2b29-4a75-8c89-9cad68947d47 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:14 devstack sudo[94128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1bb83570-2b29-4a75-8c89-9cad68947d47
Jun 06 01:08:14 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:15 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1bb83570-2b29-4a75-8c89-9cad68947d47" returned: 0 in 0.857s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-c6f88edc-1318-459f-b321-29a9000464db req-e93ee6cd-9720-4a4a-a488-c26da7321c92 tempest-AttachVolumeShelveTestJSON-2132915721 None] No connector for attachment 6c8c30f3-5a2b-4fcf-8e9a-3111d9379d63; skipping storage backend terminate_connection call. {{(pid=86581) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-c6f88edc-1318-459f-b321-29a9000464db req-e93ee6cd-9720-4a4a-a488-c26da7321c92 tempest-AttachVolumeShelveTestJSON-2132915721 None] Deleting attachment 6c8c30f3-5a2b-4fcf-8e9a-3111d9379d63. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4255257c-8b6b-4728-9336-29c12f4255ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb83570-2b29-4a75-8c89-9cad68947d47', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517b6f58-fae8-4b54-a07b-5dfa9e91f128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:15 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Volume volume-1bb83570-2b29-4a75-8c89-9cad68947d47 (1bb83570-2b29-4a75-8c89-9cad68947d47): created successfully
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517b6f58-fae8-4b54-a07b-5dfa9e91f128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Flow 'volume_create_manager' (004cc520-e648-476b-9006-49617c141761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:15 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-23ae6537-9e31-4747-ae84-71959295b428 tempest-VolumesListAdminTestJSON-1142257920 None] Created volume successfully.
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] Acquiring lock "cinder-1bb83570-2b29-4a75-8c89-9cad68947d47-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] Lock "cinder-1bb83570-2b29-4a75-8c89-9cad68947d47-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] Acquiring lock "cinder-quobyte-1bb83570-2b29-4a75-8c89-9cad68947d47" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] Lock "cinder-quobyte-1bb83570-2b29-4a75-8c89-9cad68947d47" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] Acquiring lock "cinder-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e7ded3-b94c-4f5f-a1b8-4bd50b6d2057]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1bb83570-2b29-4a75-8c89-9cad68947d47 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] Lock "cinder-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] Acquiring lock "cinder-quobyte-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] Lock "cinder-quobyte-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d" acquired by "delete_volume" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e76a12-28da-4624-abce-f00db83c50e9]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:08:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:15 devstack sudo[94134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1bb83570-2b29-4a75-8c89-9cad68947d47
Jun 06 01:08:15 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:16 devstack sudo[94139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d
Jun 06 01:08:16 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:16 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1bb83570-2b29-4a75-8c89-9cad68947d47" returned: 0 in 1.075s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1bb83570-2b29-4a75-8c89-9cad68947d47 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:16 devstack sudo[94147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1bb83570-2b29-4a75-8c89-9cad68947d47
Jun 06 01:08:16 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:17 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d" returned: 0 in 1.330s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:17 devstack sudo[94154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d
Jun 06 01:08:17 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:17 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1bb83570-2b29-4a75-8c89-9cad68947d47" returned: 0 in 0.807s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] Lock "cinder-quobyte-1bb83570-2b29-4a75-8c89-9cad68947d47" released by "delete_volume" :: held 1.959s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:08:17 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] Created reservations ['d3b9ec84-97ef-42d8-b032-f9765dfd0037', '742f9ec5-9fdf-4dfe-8505-36cb7bc9d98a', '9585c8c8-5101-4b9d-9196-30486e05c0bd', '5a076654-8ad2-4d30-acd5-975668632d53'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:08:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:08:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:08:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:17 devstack sudo[94157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:08:17 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:18 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d" returned: 0 in 0.952s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:18 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] Lock "cinder-quobyte-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d" released by "delete_volume" :: held 2.381s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:08:18 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] Created reservations ['fbbb99d9-fb8f-471f-a252-f87213511efe', 'ea2a71da-8b21-49cd-8ce9-07b210197fa5', '047ee3ae-cbeb-474c-a435-76eccc6a0550', '062c15d5-8cdd-4fbe-ad7b-167cf4976485'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:08:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:18 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:08:18 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:08:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:18 devstack sudo[94161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:08:18 devstack sudo[94161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:18 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.944s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:18 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:08:18 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] Deleted volume successfully.
Jun 06 01:08:18 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8162039a-51d2-4aba-bfbc-229e2ec78c37 tempest-VolumesListAdminTestJSON-1142257920 None] Lock "cinder-1bb83570-2b29-4a75-8c89-9cad68947d47-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:08:19 devstack sudo[94161]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.757s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:19 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:08:19 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] Deleted volume successfully.
Jun 06 01:08:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] Acquiring lock "cinder-ba57317e-65eb-44f2-ae04-e4e2129b3d8b-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:08:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-36e3277f-0c48-48a3-b85e-7c40092eed0f tempest-VolumesListAdminTestJSON-821234699 None] Lock "cinder-a4d1cbf3-33f4-4db6-8326-ab8c375ab20d-delete_volume" released by "delete_volume" :: held 3.456s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:08:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] Lock "cinder-ba57317e-65eb-44f2-ae04-e4e2129b3d8b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:08:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] Acquiring lock "cinder-quobyte-ba57317e-65eb-44f2-ae04-e4e2129b3d8b" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:08:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] Lock "cinder-quobyte-ba57317e-65eb-44f2-ae04-e4e2129b3d8b" acquired by "delete_volume" :: waited 0.028s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:08:19 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[577ea129-5c1b-467d-83c4-5a3019dabc81]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:08:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ba57317e-65eb-44f2-ae04-e4e2129b3d8b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:19 devstack sudo[94165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ba57317e-65eb-44f2-ae04-e4e2129b3d8b
Jun 06 01:08:19 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:20 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ba57317e-65eb-44f2-ae04-e4e2129b3d8b" returned: 0 in 0.803s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ba57317e-65eb-44f2-ae04-e4e2129b3d8b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:20 devstack sudo[94170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ba57317e-65eb-44f2-ae04-e4e2129b3d8b
Jun 06 01:08:20 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:20 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ba57317e-65eb-44f2-ae04-e4e2129b3d8b" returned: 0 in 0.720s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] Lock "cinder-quobyte-ba57317e-65eb-44f2-ae04-e4e2129b3d8b" released by "delete_volume" :: held 1.584s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:08:20 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] Created reservations ['a43219fd-e0b6-46f6-815e-82fe9aa81c83', 'd1cae40c-0eed-4e92-98fc-54c4baf2a7fa', 'b26f700d-bd60-4d22-b3a7-529351927f47', 'bf344083-65ea-4f17-81db-b63fac1ba4a8'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:08:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:21 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:08:21 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:08:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:21 devstack sudo[94173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:08:21 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] Acquiring lock "cinder-dd95a462-d8d2-4f08-bf38-c8be81d09a43-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:08:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] Lock "cinder-dd95a462-d8d2-4f08-bf38-c8be81d09a43-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:08:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] Acquiring lock "cinder-quobyte-dd95a462-d8d2-4f08-bf38-c8be81d09a43" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:08:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] Lock "cinder-quobyte-dd95a462-d8d2-4f08-bf38-c8be81d09a43" acquired by "delete_volume" :: waited 0.025s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:08:21 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf85f15-ba7e-450a-8478-dfb8fdc6d090]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:08:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dd95a462-d8d2-4f08-bf38-c8be81d09a43 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:21 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.734s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:21 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:08:21 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] Deleted volume successfully.
Jun 06 01:08:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-25f727b4-b08f-4211-8077-a5fd29e78681 tempest-VolumesListAdminTestJSON-821234699 None] Lock "cinder-ba57317e-65eb-44f2-ae04-e4e2129b3d8b-delete_volume" released by "delete_volume" :: held 2.567s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:08:21 devstack sudo[94176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dd95a462-d8d2-4f08-bf38-c8be81d09a43
Jun 06 01:08:21 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:22 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dd95a462-d8d2-4f08-bf38-c8be81d09a43" returned: 0 in 0.863s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dd95a462-d8d2-4f08-bf38-c8be81d09a43 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:22 devstack sudo[94182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dd95a462-d8d2-4f08-bf38-c8be81d09a43
Jun 06 01:08:22 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:23 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dd95a462-d8d2-4f08-bf38-c8be81d09a43" returned: 0 in 0.702s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] Lock "cinder-quobyte-dd95a462-d8d2-4f08-bf38-c8be81d09a43" released by "delete_volume" :: held 1.615s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:08:23 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] Created reservations ['3304689d-f535-4230-8599-5e4896ce01fc', '6dcb0f2e-160a-4aec-8df6-b538a7f7e07b', 'a201854f-be2d-43be-a5d7-cf1df6a55e58', 'f7519cce-747d-4f9b-b206-1a9ba198828a'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:08:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:08:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:08:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:23 devstack sudo[94186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:08:23 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:24 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.713s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:24 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:08:24 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] Deleted volume successfully.
Jun 06 01:08:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9c26dea8-ae7f-491a-9628-0a6addcb6c30 tempest-VolumesListAdminTestJSON-821234699 None] Lock "cinder-dd95a462-d8d2-4f08-bf38-c8be81d09a43-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:08:33 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=40,cinder:UPDATE=62,cinder:INSERT=11,cinder:DELETE=7 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:08:34 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=64,cinder:SELECT=41,cinder:INSERT=18,cinder:DELETE=4 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Flow 'volume_create_manager' (fee387fb-1260-4ab9-b673-05fd6a8c95f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75478902-5371-4c48-b2ff-6ef62af22bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75478902-5371-4c48-b2ff-6ef62af22bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1907137896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24f61d8-f98c-491a-babb-52b44ba906f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ffe38397efd4f64acac202af7487f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:37Z,use_quota=True,user_id='a78b549019d94d52bf733c94253d72bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdcfdb37-fd54-4c88-99b0-175f96c13367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdcfdb37-fd54-4c88-99b0-175f96c13367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f78dda-8b71-4b2f-b14a-3ff64f7c553d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f78dda-8b71-4b2f-b14a-3ff64f7c553d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24f61d8-f98c-491a-babb-52b44ba906f0', 'volume_name': 'volume-b24f61d8-f98c-491a-babb-52b44ba906f0', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63117f06-6575-4f69-a597-a1dfe6f7d854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63117f06-6575-4f69-a597-a1dfe6f7d854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f38b0d6-6a4f-4ca0-9c59-90034d52cd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:37 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Volume b24f61d8-f98c-491a-babb-52b44ba906f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24f61d8-f98c-491a-babb-52b44ba906f0', 'volume_size': 1}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1907137896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24f61d8-f98c-491a-babb-52b44ba906f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ffe38397efd4f64acac202af7487f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:37Z,use_quota=True,user_id='a78b549019d94d52bf733c94253d72bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Creating volume b24f61d8-f98c-491a-babb-52b44ba906f0 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:08:37 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:08:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b24f61d8-f98c-491a-babb-52b44ba906f0 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:37 devstack sudo[94194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b24f61d8-f98c-491a-babb-52b44ba906f0 1073741824
Jun 06 01:08:37 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:38 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b24f61d8-f98c-491a-babb-52b44ba906f0 1073741824" returned: 0 in 1.136s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b24f61d8-f98c-491a-babb-52b44ba906f0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:38 devstack sudo[94201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b24f61d8-f98c-491a-babb-52b44ba906f0
Jun 06 01:08:38 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:39 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b24f61d8-f98c-491a-babb-52b44ba906f0" returned: 0 in 0.781s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:08:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f38b0d6-6a4f-4ca0-9c59-90034d52cd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24f61d8-f98c-491a-babb-52b44ba906f0', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f8842e5-57b1-4d57-a8fc-6486947d8706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:39 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Volume volume-b24f61d8-f98c-491a-babb-52b44ba906f0 (b24f61d8-f98c-491a-babb-52b44ba906f0): created successfully
Jun 06 01:08:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f8842e5-57b1-4d57-a8fc-6486947d8706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Flow 'volume_create_manager' (fee387fb-1260-4ab9-b673-05fd6a8c95f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:39 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-e81a4a22-68a6-45d0-a6c3-078043805d83 tempest-VolumesMetadataTest-1772794294 None] Created volume successfully.
Jun 06 01:08:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] Acquiring lock "cinder-b24f61d8-f98c-491a-babb-52b44ba906f0-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:08:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] Lock "cinder-b24f61d8-f98c-491a-babb-52b44ba906f0-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:08:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] Acquiring lock "cinder-quobyte-b24f61d8-f98c-491a-babb-52b44ba906f0" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:08:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] Lock "cinder-quobyte-b24f61d8-f98c-491a-babb-52b44ba906f0" acquired by "delete_volume" :: waited 0.029s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:08:41 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e9371e-66ae-4cb5-bebf-e24c78c2e44a]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:08:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b24f61d8-f98c-491a-babb-52b44ba906f0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:41 devstack sudo[94238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b24f61d8-f98c-491a-babb-52b44ba906f0
Jun 06 01:08:41 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:42 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b24f61d8-f98c-491a-babb-52b44ba906f0" returned: 0 in 1.193s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b24f61d8-f98c-491a-babb-52b44ba906f0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:42 devstack sudo[94245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b24f61d8-f98c-491a-babb-52b44ba906f0
Jun 06 01:08:42 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:42 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:08:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Flow 'volume_create_manager' (9e9f6065-e9be-4f84-81f3-a25ccb99ddec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e808aff7-8ca9-4405-88ae-045e3ea3bffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e808aff7-8ca9-4405-88ae-045e3ea3bffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1341725064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=121cfdad-1228-444b-8c59-e5b970587f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486f7c9509784007ad373fa4b36498c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:43Z,use_quota=True,user_id='1d15e69ab6c74b0c87e8f835b4dd4d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1920361-5649-4fe8-925a-099b20ca24b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1920361-5649-4fe8-925a-099b20ca24b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9558c4-8c17-4b90-ab1a-589bf63d5c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9558c4-8c17-4b90-ab1a-589bf63d5c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '121cfdad-1228-444b-8c59-e5b970587f42', 'volume_name': 'volume-121cfdad-1228-444b-8c59-e5b970587f42', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791e00da-1ce6-43ce-b718-7fbcf40e36e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791e00da-1ce6-43ce-b718-7fbcf40e36e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03457735-78db-4b20-b781-d041d4098327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:43 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Volume 121cfdad-1228-444b-8c59-e5b970587f42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-121cfdad-1228-444b-8c59-e5b970587f42', 'volume_size': 1}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1341725064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=121cfdad-1228-444b-8c59-e5b970587f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486f7c9509784007ad373fa4b36498c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:43Z,use_quota=True,user_id='1d15e69ab6c74b0c87e8f835b4dd4d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Creating volume 121cfdad-1228-444b-8c59-e5b970587f42 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:08:43 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-121cfdad-1228-444b-8c59-e5b970587f42 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:43 devstack sudo[94247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-121cfdad-1228-444b-8c59-e5b970587f42 1073741824
Jun 06 01:08:43 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Flow 'volume_create_manager' (5936e107-a9b9-4be3-8960-61f1bd29d533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25fbd0bb-ba4c-4408-9d8d-70eb5e5b8c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25fbd0bb-ba4c-4408-9d8d-70eb5e5b8c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-610806670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a513d5e4-ef61-429d-aba5-e51ec92f471a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486f7c9509784007ad373fa4b36498c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:43Z,use_quota=True,user_id='1d15e69ab6c74b0c87e8f835b4dd4d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920958c5-847b-4c08-acd5-356931929c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920958c5-847b-4c08-acd5-356931929c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08bcf3f-e7ac-4dc1-8197-30337de2279f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08bcf3f-e7ac-4dc1-8197-30337de2279f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a513d5e4-ef61-429d-aba5-e51ec92f471a', 'volume_name': 'volume-a513d5e4-ef61-429d-aba5-e51ec92f471a', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76638753-e260-4308-b4b5-bbcc2031faf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76638753-e260-4308-b4b5-bbcc2031faf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865b6639-148c-4fe4-a261-b6ef53777e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:43 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Volume a513d5e4-ef61-429d-aba5-e51ec92f471a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a513d5e4-ef61-429d-aba5-e51ec92f471a', 'volume_size': 1}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:43 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b24f61d8-f98c-491a-babb-52b44ba906f0" returned: 0 in 0.998s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] Lock "cinder-quobyte-b24f61d8-f98c-491a-babb-52b44ba906f0" released by "delete_volume" :: held 2.271s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] Created reservations ['23b310c9-9e88-4115-bc17-3a8abc2d8565', '7f31dba8-ce88-4f3f-bf5b-7b136731b38e', 'b9b58f2f-b204-4b1a-9116-8aaabf739f7f', 'fd0fb82c-8117-4267-8508-c6a56a07b000'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:43 devstack sudo[94253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:08:43 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:44 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-121cfdad-1228-444b-8c59-e5b970587f42 1073741824" returned: 0 in 1.251s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-121cfdad-1228-444b-8c59-e5b970587f42 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:44 devstack sudo[94261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-121cfdad-1228-444b-8c59-e5b970587f42
Jun 06 01:08:44 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:44 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.807s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:44 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:08:44 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] Deleted volume successfully.
Jun 06 01:08:44 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b72fbb02-23c7-4745-bbf3-0f2aada69cda tempest-VolumesMetadataTest-1772794294 None] Lock "cinder-b24f61d8-f98c-491a-babb-52b44ba906f0-delete_volume" released by "delete_volume" :: held 3.424s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:08:45 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-121cfdad-1228-444b-8c59-e5b970587f42" returned: 0 in 0.811s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] <== create_volume: return (2118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:08:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.122s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.656s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-610806670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a513d5e4-ef61-429d-aba5-e51ec92f471a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486f7c9509784007ad373fa4b36498c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:43Z,use_quota=True,user_id='1d15e69ab6c74b0c87e8f835b4dd4d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:08:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Creating volume a513d5e4-ef61-429d-aba5-e51ec92f471a {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:08:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:08:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:08:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:08:45 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:08:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a513d5e4-ef61-429d-aba5-e51ec92f471a 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:45 devstack sudo[94266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a513d5e4-ef61-429d-aba5-e51ec92f471a 1073741824
Jun 06 01:08:45 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03457735-78db-4b20-b781-d041d4098327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-121cfdad-1228-444b-8c59-e5b970587f42', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b9efae-d484-4d2c-bb13-1279cd877b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:45 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Volume volume-121cfdad-1228-444b-8c59-e5b970587f42 (121cfdad-1228-444b-8c59-e5b970587f42): created successfully
Jun 06 01:08:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b9efae-d484-4d2c-bb13-1279cd877b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Flow 'volume_create_manager' (9e9f6065-e9be-4f84-81f3-a25ccb99ddec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:45 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-5df4c47d-b900-4d69-8cbf-325247928edd tempest-TestServerVolumeAttachmentScenario-531005618 None] Created volume successfully.
Jun 06 01:08:46 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a513d5e4-ef61-429d-aba5-e51ec92f471a 1073741824" returned: 0 in 1.503s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a513d5e4-ef61-429d-aba5-e51ec92f471a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:46 devstack sudo[94333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a513d5e4-ef61-429d-aba5-e51ec92f471a
Jun 06 01:08:46 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:48 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a513d5e4-ef61-429d-aba5-e51ec92f471a" returned: 0 in 1.404s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] <== create_volume: return (3026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:08:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.031s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865b6639-148c-4fe4-a261-b6ef53777e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a513d5e4-ef61-429d-aba5-e51ec92f471a', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a4a0dd-6dd9-455d-8f9c-804c8370626f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:48 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Volume volume-a513d5e4-ef61-429d-aba5-e51ec92f471a (a513d5e4-ef61-429d-aba5-e51ec92f471a): created successfully
Jun 06 01:08:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a4a0dd-6dd9-455d-8f9c-804c8370626f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Flow 'volume_create_manager' (5936e107-a9b9-4be3-8960-61f1bd29d533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:48 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-14bb9aca-f43b-45d7-8e30-b3b73bb472e2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Created volume successfully.
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Flow 'volume_create_manager' (cc4b9233-e4c6-45d1-a329-677c142c0aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd754d27-a934-4d0d-b41f-3e35ac3a9ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd754d27-a934-4d0d-b41f-3e35ac3a9ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1781126174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64aa4cc5-6606-4f82-b81f-6ef1f16ada9a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='57f5c4ca37aa4ecea394b3d70489c57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:50Z,use_quota=True,user_id='4fc74b005a0744f8a280f8bdd0fba220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (916f0896-d85e-4937-bef7-e469dbf9aacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (916f0896-d85e-4937-bef7-e469dbf9aacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b747fdce-8827-45da-9e24-ea60a5f2435f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b747fdce-8827-45da-9e24-ea60a5f2435f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64aa4cc5-6606-4f82-b81f-6ef1f16ada9a', 'volume_name': 'volume-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04984e85-ecac-4b8a-ba03-cae843bb47f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04984e85-ecac-4b8a-ba03-cae843bb47f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db7635f-ac48-4f0b-9511-e3bd24cd43b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:50 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Volume 64aa4cc5-6606-4f82-b81f-6ef1f16ada9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a', 'volume_size': 1}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1781126174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64aa4cc5-6606-4f82-b81f-6ef1f16ada9a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='57f5c4ca37aa4ecea394b3d70489c57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:50Z,use_quota=True,user_id='4fc74b005a0744f8a280f8bdd0fba220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Creating volume 64aa4cc5-6606-4f82-b81f-6ef1f16ada9a {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:08:50 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:08:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:50 devstack sudo[94343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a 1073741824
Jun 06 01:08:50 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:51 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a 1073741824" returned: 0 in 1.213s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:51 devstack sudo[94354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a
Jun 06 01:08:51 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:52 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a" returned: 0 in 0.844s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:52 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:08:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:52 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db7635f-ac48-4f0b-9511-e3bd24cd43b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:52 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53644984-ee77-4e32-b51a-f72bb62eed09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:52 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Volume volume-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a (64aa4cc5-6606-4f82-b81f-6ef1f16ada9a): created successfully
Jun 06 01:08:52 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53644984-ee77-4e32-b51a-f72bb62eed09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:52 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Flow 'volume_create_manager' (cc4b9233-e4c6-45d1-a329-677c142c0aa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:52 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d35507c7-9444-41c2-9db4-33817042b52a tempest-VolumesGetTest-1018775238 None] Created volume successfully.
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Flow 'volume_create_manager' (43eb7dae-f127-463a-8e9f-c47bc654d188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20df65ea-72a0-4ed5-aab1-577be92ae1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20df65ea-72a0-4ed5-aab1-577be92ae1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2106660075',display_name='tempest-VolumesGetTest-Volume-288246370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c28f4a-3e8d-4a64-b8ad-5826f79d05f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f5c4ca37aa4ecea394b3d70489c57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:54Z,use_quota=True,user_id='4fc74b005a0744f8a280f8bdd0fba220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4821d7ec-3661-436d-8c70-65da8b3bf8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4821d7ec-3661-436d-8c70-65da8b3bf8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504c1506-260b-499d-93ad-1bd279cad9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504c1506-260b-499d-93ad-1bd279cad9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01c28f4a-3e8d-4a64-b8ad-5826f79d05f6', 'volume_name': 'volume-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ea7918-315b-4342-adc1-5704b03cd66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ea7918-315b-4342-adc1-5704b03cd66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9f5b5d-5775-470b-9cb2-c9ae215b990c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:53 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Volume 01c28f4a-3e8d-4a64-b8ad-5826f79d05f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6', 'volume_size': 1}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:08:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2106660075',display_name='tempest-VolumesGetTest-Volume-288246370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c28f4a-3e8d-4a64-b8ad-5826f79d05f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f5c4ca37aa4ecea394b3d70489c57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:08:54Z,use_quota=True,user_id='4fc74b005a0744f8a280f8bdd0fba220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Creating volume 01c28f4a-3e8d-4a64-b8ad-5826f79d05f6 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:08:53 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:08:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:54 devstack sudo[94370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6 1073741824
Jun 06 01:08:54 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:54 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6 1073741824" returned: 0 in 0.909s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:55 devstack sudo[94379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6
Jun 06 01:08:55 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:55 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6" returned: 0 in 0.841s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:08:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9f5b5d-5775-470b-9cb2-c9ae215b990c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104c2cfb-8b6d-415d-9648-d8e6f24a854f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:08:55 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Volume volume-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6 (01c28f4a-3e8d-4a64-b8ad-5826f79d05f6): created successfully
Jun 06 01:08:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104c2cfb-8b6d-415d-9648-d8e6f24a854f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:08:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Flow 'volume_create_manager' (43eb7dae-f127-463a-8e9f-c47bc654d188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:08:55 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-8c4d8785-37b8-496b-a630-8a3debc3f5f5 tempest-VolumesGetTest-1018775238 None] Created volume successfully.
Jun 06 01:08:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] Acquiring lock "cinder-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:08:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] Lock "cinder-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:08:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] Acquiring lock "cinder-quobyte-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:08:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6" acquired by "delete_volume" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:08:56 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb909694-5a99-4e0f-80eb-d50006e6f5a7]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:08:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:56 devstack sudo[94384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6
Jun 06 01:08:56 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:58 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6" returned: 0 in 2.128s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:58 devstack sudo[94471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6
Jun 06 01:08:58 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:08:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:08:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:08:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:59 devstack sudo[94474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:08:59 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:08:59 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root
Jun 06 01:08:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6" returned: 0 in 0.878s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:08:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6" released by "delete_volume" :: held 3.063s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:08:59 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] Created reservations ['00d8f933-d790-46a3-8287-dc05c0d7f10a', 'aec35cdd-9bb0-4742-a273-53de78c061fc', 'cece5281-165c-4188-ad48-e6c2064d766c', '4e2c7c4e-0750-418b-a3bb-34fb142b75f9'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:08:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:08:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:08:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:08:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:08:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:08:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:08:59 devstack sudo[94480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:08:59 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] Acquiring lock "cinder-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:09:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] Lock "cinder-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:09:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] Acquiring lock "cinder-quobyte-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:09:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a" acquired by "delete_volume" :: waited 0.045s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:09:00 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e5e2c8-7a8f-465b-bf18-a68dccaeeeb7]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:00 devstack sudo[94482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a
Jun 06 01:09:00 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:00 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.477s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:09:01 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.438s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:01 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:09:01 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] Deleted volume successfully.
Jun 06 01:09:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-83ff2455-fe5e-42ec-a8a0-73d05f0afa50 tempest-VolumesGetTest-1018775238 None] Lock "cinder-01c28f4a-3e8d-4a64-b8ad-5826f79d05f6-delete_volume" released by "delete_volume" :: held 4.912s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:09:01 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a" returned: 0 in 1.304s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:01 devstack sudo[94490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a
Jun 06 01:09:01 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:02 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a" returned: 0 in 0.921s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:02 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a" released by "delete_volume" :: held 2.332s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:09:02 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] Created reservations ['dbc1e51f-1911-449b-b6f0-20d38c0da43c', '0e8d400f-f8f9-41e6-8841-92fa087ee16d', '4f51af92-0bf3-4fb8-8a0c-5548d2883a76', 'ec9c5994-1289-431e-ac66-061e06c2202a'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:09:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:02 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:09:02 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:09:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:02 devstack sudo[94499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:09:02 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:03 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.671s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:03 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:09:03 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] Deleted volume successfully.
Jun 06 01:09:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ad4c439e-9c04-4064-8f9d-42721a5d22a6 tempest-VolumesGetTest-1018775238 None] Lock "cinder-64aa4cc5-6606-4f82-b81f-6ef1f16ada9a-delete_volume" released by "delete_volume" :: held 3.367s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Flow 'volume_create_manager' (e63567cc-b9db-4d00-b658-1dc7b1729d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f2388a-b692-4cc1-8eb2-5bd087c5a48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f2388a-b692-4cc1-8eb2-5bd087c5a48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1446634940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f5c4ca37aa4ecea394b3d70489c57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:09:04Z,use_quota=True,user_id='4fc74b005a0744f8a280f8bdd0fba220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e73b720-4567-48e1-b1e2-26c4ab3058ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e73b720-4567-48e1-b1e2-26c4ab3058ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (620132a5-9ade-400a-b899-626bc9a3fda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (620132a5-9ade-400a-b899-626bc9a3fda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c', 'volume_name': 'volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab6fcea-441e-4ff0-b88a-fff98809a8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab6fcea-441e-4ff0-b88a-fff98809a8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f0c75c-c829-4443-85bd-f8cafc514ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:04 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Volume 5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c', 'volume_size': 1}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1446634940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f5c4ca37aa4ecea394b3d70489c57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:09:04Z,use_quota=True,user_id='4fc74b005a0744f8a280f8bdd0fba220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Creating volume 5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:09:04 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:09:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:04 devstack sudo[94550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c 1073741824
Jun 06 01:09:04 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:05 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c 1073741824" returned: 0 in 1.160s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:05 devstack sudo[94574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c
Jun 06 01:09:05 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:06 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c" returned: 0 in 0.748s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:09:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f0c75c-c829-4443-85bd-f8cafc514ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717e060d-9dba-4ca3-b083-e5a16924e801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:06 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Volume volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c (5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c): created successfully
Jun 06 01:09:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717e060d-9dba-4ca3-b083-e5a16924e801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Flow 'volume_create_manager' (e63567cc-b9db-4d00-b658-1dc7b1729d76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:09:06 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-3f2e0066-a180-4303-af8f-dfe55824ba74 tempest-VolumesGetTest-1018775238 None] Created volume successfully.
Jun 06 01:09:08 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:09:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Flow 'volume_create_manager' (68370e22-8c84-416c-b086-fede0054c322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:09:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc889dbc-f6e0-45c6-86f6-cd442596936c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc889dbc-f6e0-45c6-86f6-cd442596936c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-164537177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec12fb7-2f86-464d-a431-1eb1c786f1f2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='57f5c4ca37aa4ecea394b3d70489c57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c,status='creating',terminated_at=None,updated_at=2026-06-05T23:09:08Z,use_quota=True,user_id='4fc74b005a0744f8a280f8bdd0fba220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e3ee3d-966d-4116-8a61-a0c081b09d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e3ee3d-966d-4116-8a61-a0c081b09d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3df34ca-a25c-4ef5-8bf3-8fdc4d0e9e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3df34ca-a25c-4ef5-8bf3-8fdc4d0e9e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fec12fb7-2f86-464d-a431-1eb1c786f1f2', 'volume_name': 'volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2', 'volume_size': 1, 'source_volid': '5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c', 'source_volstatus': 'available'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af913d8a-8814-4603-87e5-da8fac0b90dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af913d8a-8814-4603-87e5-da8fac0b90dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7822de09-a952-46f5-a98d-2f9eab96b50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:08 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Volume fec12fb7-2f86-464d-a431-1eb1c786f1f2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2', 'volume_size': 1, 'source_volid': '5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c', 'source_volstatus': 'available'}
Jun 06 01:09:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:08 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Cloning volume 5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c to volume fec12fb7-2f86-464d-a431-1eb1c786f1f2
Jun 06 01:09:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Creating offline snapshot 849de6cb-4096-4776-816e-e47e528d764e of volume 5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:09:08 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[4334bc13-0b62-4ee5-967a-df3a8dca684a]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:08 devstack sudo[94615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c
Jun 06 01:09:08 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:09 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c" returned: 0 in 1.014s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:09 devstack sudo[94623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e 1G
Jun 06 01:09:09 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:11 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e 1G" returned: 0 in 1.315s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:11 devstack sudo[94663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e
Jun 06 01:09:11 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:12 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e" returned: 0 in 1.040s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:12 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e is being set with open permissions: ugo+rw
Jun 06 01:09:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:12 devstack sudo[94670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e
Jun 06 01:09:12 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:13 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e" returned: 0 in 1.024s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:13 devstack sudo[94677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.info
Jun 06 01:09:13 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:13 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.info" returned: 0 in 0.671s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:13 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.info is being set with open permissions: ugo+rw
Jun 06 01:09:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:13 devstack sudo[94699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.info
Jun 06 01:09:13 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:14 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.info" returned: 0 in 0.723s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Acquiring lock "cinder-quobyte-fec12fb7-2f86-464d-a431-1eb1c786f1f2" by "_copy_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:09:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-fec12fb7-2f86-464d-a431-1eb1c786f1f2" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:09:14 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] snapshot: 849de6cb-4096-4776-816e-e47e528d764e, volume: fec12fb7-2f86-464d-a431-1eb1c786f1f2,  {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 06 01:09:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:14 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:09:14 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:09:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:14 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[5188bdf8-b275-4aab-8b16-65f78afd9de7]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:14 devstack sudo[94702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e
Jun 06 01:09:14 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:15 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e" returned: 0 in 0.742s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:09:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 06 01:09:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Creating direct copy from snapshot {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 06 01:09:15 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f0ee6e-603e-4aff-bcd6-fa47a4329f29]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:15 devstack sudo[94707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c
Jun 06 01:09:15 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:16 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c" returned: 0 in 0.737s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:16 devstack cinder-volume[86581]: DEBUG cinder.utils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Path /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2 not found in is_blk_device check {{(pid=86581) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jun 06 01:09:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:16 devstack sudo[94718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2
Jun 06 01:09:16 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] Acquiring lock "cinder-9c3ee914-e929-4320-aba1-71087b9cc38e-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:09:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "cinder-9c3ee914-e929-4320-aba1-71087b9cc38e-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:09:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] Acquiring lock "cinder-quobyte-9c3ee914-e929-4320-aba1-71087b9cc38e" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:09:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "cinder-quobyte-9c3ee914-e929-4320-aba1-71087b9cc38e" acquired by "delete_volume" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:09:19 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c23d45-0bbb-47d6-836b-473fc333c30f]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9c3ee914-e929-4320-aba1-71087b9cc38e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:19 devstack sudo[94732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9c3ee914-e929-4320-aba1-71087b9cc38e
Jun 06 01:09:19 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:20 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9c3ee914-e929-4320-aba1-71087b9cc38e" returned: 0 in 1.477s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9c3ee914-e929-4320-aba1-71087b9cc38e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:20 devstack sudo[94750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9c3ee914-e929-4320-aba1-71087b9cc38e
Jun 06 01:09:20 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:22 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9c3ee914-e929-4320-aba1-71087b9cc38e" returned: 0 in 1.332s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "cinder-quobyte-9c3ee914-e929-4320-aba1-71087b9cc38e" released by "delete_volume" :: held 2.947s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:09:22 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] Created reservations ['682babb2-1c70-4a8d-a4f2-705daa5d48b4', '171f9b93-b12f-4015-9970-b40cde3bc6a2', '1c999609-0b29-493b-9967-8723a1914b9a', 'a481b4a5-95a2-41a2-9c4d-d5e46883c818'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:09:22 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2" returned: 0 in 6.287s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:09:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:09:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:22 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c2fd49-bb6d-4967-a0e0-7757ab16540e]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:22 devstack sudo[94753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:09:22 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:22 devstack sudo[94754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c
Jun 06 01:09:22 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] Acquiring lock "cinder-31d520cb-2438-4025-a182-9aab375276fc-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:09:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "cinder-31d520cb-2438-4025-a182-9aab375276fc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:09:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] Acquiring lock "cinder-quobyte-31d520cb-2438-4025-a182-9aab375276fc" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:09:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "cinder-quobyte-31d520cb-2438-4025-a182-9aab375276fc" acquired by "delete_volume" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:09:23 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[1222e605-0e62-441a-a379-05c01887e8c1]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-31d520cb-2438-4025-a182-9aab375276fc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:23 devstack sudo[94758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-31d520cb-2438-4025-a182-9aab375276fc
Jun 06 01:09:23 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:23 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.678s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:23 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:09:23 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] Deleted volume successfully.
Jun 06 01:09:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2b4835c-75f1-471f-8800-c26cf3f53728 tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "cinder-9c3ee914-e929-4320-aba1-71087b9cc38e-delete_volume" released by "delete_volume" :: held 3.981s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:09:23 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c" returned: 0 in 1.022s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:23 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Image conversion details: src /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2 {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:09:23 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Converted 1024.00 MB image at 162.87 MB/s
Jun 06 01:09:23 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2 is being set with open permissions: ugo+rw
Jun 06 01:09:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:23 devstack sudo[94765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2
Jun 06 01:09:23 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:23 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-31d520cb-2438-4025-a182-9aab375276fc" returned: 0 in 0.769s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-31d520cb-2438-4025-a182-9aab375276fc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:23 devstack sudo[94770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-31d520cb-2438-4025-a182-9aab375276fc
Jun 06 01:09:23 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:24 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2" returned: 0 in 0.602s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-fec12fb7-2f86-464d-a431-1eb1c786f1f2" released by "_copy_volume_from_snapshot" :: held 9.502s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Acquiring lock "cinder-quobyte-849de6cb-4096-4776-816e-e47e528d764e" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-849de6cb-4096-4776-816e-e47e528d764e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Deleting offline snapshot 849de6cb-4096-4776-816e-e47e528d764e of volume 5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] snapshot_file for this snap is: volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19cb383-14a2-4a35-b886-441b5b0a16aa]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:24 devstack sudo[94773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e
Jun 06 01:09:24 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:24 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-31d520cb-2438-4025-a182-9aab375276fc" returned: 0 in 0.640s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "cinder-quobyte-31d520cb-2438-4025-a182-9aab375276fc" released by "delete_volume" :: held 1.459s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] Created reservations ['82c103bc-4e76-4a26-a46f-64d1bdb6bcc4', '22b6e2f8-a76f-45d6-a3a6-a4d22c761565', '53c4c204-c467-4dd1-a5d6-93587f55d156', '06bd0a24-d4d2-486e-ba99-389c65f5ddbe'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:24 devstack sudo[94776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:09:24 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:24 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e" returned: 0 in 0.724s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe86508-c4c1-45b0-adb9-82482cfac85d]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:25 devstack sudo[94785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c
Jun 06 01:09:25 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:25 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.650s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:25 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:09:25 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] Deleted volume successfully.
Jun 06 01:09:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e3cf98c5-02ea-46d0-b737-f58593a7218f tempest-AttachVolumeShelveTestJSON-2132915721 None] Lock "cinder-31d520cb-2438-4025-a182-9aab375276fc-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:09:25 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:09:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Flow 'volume_create_manager' (af6c4876-3dfa-4cb8-8478-2a9528cc7792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:09:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb55ede9-04e7-44e1-81fd-9401cf6674a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb55ede9-04e7-44e1-81fd-9401cf6674a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1193589575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85545b47-20c8-4f75-b20c-a4aeeb171a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540001cc42e2416b8f5ba9561fb606e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:09:26Z,use_quota=True,user_id='3903acbc55da484cbeb4d634428ee9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da21bf91-5bcf-4d8a-8411-e17d0f2d8d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da21bf91-5bcf-4d8a-8411-e17d0f2d8d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f4d556-12ea-42ba-830a-ce19ab557811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f4d556-12ea-42ba-830a-ce19ab557811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85545b47-20c8-4f75-b20c-a4aeeb171a2b', 'volume_name': 'volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95185e39-1583-467b-b822-85111b3db04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95185e39-1583-467b-b822-85111b3db04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6f90bd-47cd-417a-a14e-f8950af63b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:25 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Volume 85545b47-20c8-4f75-b20c-a4aeeb171a2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b', 'volume_size': 1}
Jun 06 01:09:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:25 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c" returned: 0 in 0.799s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:25 devstack sudo[94793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e
Jun 06 01:09:25 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:26 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e" returned: 0 in 0.699s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:26 devstack sudo[94800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e
Jun 06 01:09:26 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:27 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c.849de6cb-4096-4776-816e-e47e528d764e" returned: 0 in 0.647s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:27 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-849de6cb-4096-4776-816e-e47e528d764e" released by "_delete_snapshot" :: held 2.961s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:09:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.487s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.429s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1193589575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85545b47-20c8-4f75-b20c-a4aeeb171a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540001cc42e2416b8f5ba9561fb606e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:09:26Z,use_quota=True,user_id='3903acbc55da484cbeb4d634428ee9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:09:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Creating volume 85545b47-20c8-4f75-b20c-a4aeeb171a2b {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:09:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:09:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:09:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:09:27 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:09:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7822de09-a952-46f5-a98d-2f9eab96b50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2', 'volume_size': 1, 'source_volid': '5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c', 'source_volstatus': 'available'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d7a99c-1d65-4b2c-8b0a-c7dd43436878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:27 devstack sudo[94804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b 1073741824
Jun 06 01:09:27 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:27 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Volume volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2 (fec12fb7-2f86-464d-a431-1eb1c786f1f2): created successfully
Jun 06 01:09:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d7a99c-1d65-4b2c-8b0a-c7dd43436878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Flow 'volume_create_manager' (68370e22-8c84-416c-b086-fede0054c322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:09:27 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-5f8cfee8-5879-42b3-949f-609e10414db9 tempest-VolumesGetTest-1018775238 None] Created volume successfully.
Jun 06 01:09:28 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b 1073741824" returned: 0 in 0.974s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:28 devstack sudo[94810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b
Jun 06 01:09:28 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:28 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:09:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Flow 'volume_create_manager' (60637d3f-008e-48b2-aa01-741209e97a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:09:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d110053-9da9-4d67-b8b4-f21007a58baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d110053-9da9-4d67-b8b4-f21007a58baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:09:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1201524688',display_name='tempest-VolumesGetTest-Volume-473883177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f5c4ca37aa4ecea394b3d70489c57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:09:29Z,use_quota=True,user_id='4fc74b005a0744f8a280f8bdd0fba220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d5300f-e27b-47e1-9fd5-9182bde94aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d5300f-e27b-47e1-9fd5-9182bde94aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbd93a2-d550-4ab1-a08a-3ed84f41583a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbd93a2-d550-4ab1-a08a-3ed84f41583a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2', 'volume_name': 'volume-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c901e4-ecb7-460d-9a40-1ebf317a95ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c901e4-ecb7-460d-9a40-1ebf317a95ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72924cbf-140c-41ad-b40e-92bb9a9ca1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:28 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Volume 67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2', 'volume_size': 1}
Jun 06 01:09:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:29 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b" returned: 0 in 0.893s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:09:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.379s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:09:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1201524688',display_name='tempest-VolumesGetTest-Volume-473883177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f5c4ca37aa4ecea394b3d70489c57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:09:29Z,use_quota=True,user_id='4fc74b005a0744f8a280f8bdd0fba220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:09:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Creating volume 67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:09:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:09:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:09:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:09:29 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:09:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:29 devstack sudo[94814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2 1073741824
Jun 06 01:09:29 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6f90bd-47cd-417a-a14e-f8950af63b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d86116-27e8-4665-b209-8e6c013283f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:29 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Volume volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b (85545b47-20c8-4f75-b20c-a4aeeb171a2b): created successfully
Jun 06 01:09:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d86116-27e8-4665-b209-8e6c013283f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Flow 'volume_create_manager' (af6c4876-3dfa-4cb8-8478-2a9528cc7792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:09:29 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-1861bd24-4961-4b42-aabc-3ebbad2ffb58 tempest-AttachVolumeTestJSON-25463068 None] Created volume successfully.
Jun 06 01:09:30 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2 1073741824" returned: 0 in 1.104s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:30 devstack sudo[94826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2
Jun 06 01:09:30 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:30 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2" returned: 0 in 0.619s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:09:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72924cbf-140c-41ad-b40e-92bb9a9ca1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca8db1e-63b5-4335-9778-5bc62f8a8dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:30 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Volume volume-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2 (67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2): created successfully
Jun 06 01:09:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca8db1e-63b5-4335-9778-5bc62f8a8dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Flow 'volume_create_manager' (60637d3f-008e-48b2-aa01-741209e97a22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:09:30 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-04f696b3-7d56-4317-937c-db2208b764a2 tempest-VolumesGetTest-1018775238 None] Created volume successfully.
Jun 06 01:09:31 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] Acquiring lock "cinder-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:09:31 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] Lock "cinder-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:09:31 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] Acquiring lock "cinder-quobyte-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:09:31 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2" acquired by "delete_volume" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:09:32 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[46946765-d12c-4c62-8b34-af2f448659c7]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:32 devstack sudo[94833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2
Jun 06 01:09:32 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:32 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2" returned: 0 in 0.833s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:32 devstack sudo[94842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2
Jun 06 01:09:32 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:33 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2" returned: 0 in 0.668s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:33 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2" released by "delete_volume" :: held 1.564s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:09:33 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=48,cinder:UPDATE=68,cinder:INSERT=13,cinder:DELETE=9 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:09:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-cd3bcbf5-4a38-44a1-8ce5-a2231957f36a req-ed30f575-1531-4ff7-b598-fd44427ecbd4 tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-cd3bcbf5-4a38-44a1-8ce5-a2231957f36a req-ed30f575-1531-4ff7-b598-fd44427ecbd4 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:33 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[2388c93f-a3d6-4cd8-bd40-7916a1a7f4e0]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-cd3bcbf5-4a38-44a1-8ce5-a2231957f36a req-ed30f575-1531-4ff7-b598-fd44427ecbd4 tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-81aded53-5e87-40b4-bcad-c07d8933efdc req-4f6f9e54-40cf-4cf2-9409-3dd0adf174f2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:33 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] Created reservations ['f8799d2b-4549-43a0-8f4f-b94d39368d63', '8ae31be0-31eb-4e18-9a18-f3b616974444', '5fd80c14-d48e-4274-87ef-05f067fbe3e3', '6b7020f1-9ef4-41c3-a07a-fecf6e33b85f'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:09:33 devstack sudo[94862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b
Jun 06 01:09:33 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:33 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:09:33 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:09:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:33 devstack sudo[94864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:09:33 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:34 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.605s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:34 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:09:34 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] Deleted volume successfully.
Jun 06 01:09:34 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:34 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=59,cinder:UPDATE=78,cinder:DELETE=6,cinder:INSERT=20 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:09:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-cd3bcbf5-4a38-44a1-8ce5-a2231957f36a req-ed30f575-1531-4ff7-b598-fd44427ecbd4 tempest-AttachVolumeTestJSON-25463068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b" returned: 0 in 0.781s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-cd3bcbf5-4a38-44a1-8ce5-a2231957f36a req-ed30f575-1531-4ff7-b598-fd44427ecbd4 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.815s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-81aded53-5e87-40b4-bcad-c07d8933efdc req-4f6f9e54-40cf-4cf2-9409-3dd0adf174f2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.756s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:34 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5401964b-59ab-4fbd-99b9-ab47a0d599a5 tempest-VolumesGetTest-1018775238 None] Lock "cinder-67a4c1f2-e3bc-40dc-94c4-2c5498e4a9e2-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:09:34 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5173605-307c-4368-a6dc-222351efa602]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-81aded53-5e87-40b4-bcad-c07d8933efdc req-4f6f9e54-40cf-4cf2-9409-3dd0adf174f2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-121cfdad-1228-444b-8c59-e5b970587f42 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-cd3bcbf5-4a38-44a1-8ce5-a2231957f36a req-ed30f575-1531-4ff7-b598-fd44427ecbd4 tempest-AttachVolumeTestJSON-25463068 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3b67276-a553-4841-987e-0d4b14f63c3e', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:09:34 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-cd3bcbf5-4a38-44a1-8ce5-a2231957f36a req-ed30f575-1531-4ff7-b598-fd44427ecbd4 tempest-AttachVolumeTestJSON-25463068 None] attachment_update completed successfully.
Jun 06 01:09:34 devstack sudo[94871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-121cfdad-1228-444b-8c59-e5b970587f42
Jun 06 01:09:34 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:34 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] Acquiring lock "cinder-fec12fb7-2f86-464d-a431-1eb1c786f1f2-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:09:35 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] Lock "cinder-fec12fb7-2f86-464d-a431-1eb1c786f1f2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:09:35 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] Acquiring lock "cinder-quobyte-fec12fb7-2f86-464d-a431-1eb1c786f1f2" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:09:35 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-fec12fb7-2f86-464d-a431-1eb1c786f1f2" acquired by "delete_volume" :: waited 0.024s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:09:35 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46bb45e-909f-4ecf-bd7a-7af929659105]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:35 devstack sudo[94940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2
Jun 06 01:09:35 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:35 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-81aded53-5e87-40b4-bcad-c07d8933efdc req-4f6f9e54-40cf-4cf2-9409-3dd0adf174f2 tempest-TestServerVolumeAttachmentScenario-531005618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-121cfdad-1228-444b-8c59-e5b970587f42" returned: 0 in 0.924s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-81aded53-5e87-40b4-bcad-c07d8933efdc req-4f6f9e54-40cf-4cf2-9409-3dd0adf174f2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.958s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-81aded53-5e87-40b4-bcad-c07d8933efdc req-4f6f9e54-40cf-4cf2-9409-3dd0adf174f2 tempest-TestServerVolumeAttachmentScenario-531005618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-121cfdad-1228-444b-8c59-e5b970587f42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3e9435a-ede1-4a33-9561-f0e2ea5807a4', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:09:35 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-81aded53-5e87-40b4-bcad-c07d8933efdc req-4f6f9e54-40cf-4cf2-9409-3dd0adf174f2 tempest-TestServerVolumeAttachmentScenario-531005618 None] attachment_update completed successfully.
Jun 06 01:09:35 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2" returned: 0 in 0.862s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:35 devstack sudo[95264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2
Jun 06 01:09:35 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:36 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fec12fb7-2f86-464d-a431-1eb1c786f1f2" returned: 0 in 0.739s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:36 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-fec12fb7-2f86-464d-a431-1eb1c786f1f2" released by "delete_volume" :: held 1.650s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:09:36 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] Created reservations ['236416ec-28e0-417d-bdff-4f7cda0aaea4', 'b5fbe461-4d1c-4d2d-b31a-7bd5caa093f6', 'ec3b97ed-3cf0-4030-af29-8fbb3825bdda', 'dcca2922-d668-4318-9e71-60af36481375'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:09:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:36 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:09:36 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:09:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:36 devstack sudo[95269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:09:36 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:37 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] Acquiring lock "cinder-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:09:37 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] Lock "cinder-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:09:37 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.628s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:37 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:09:37 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] Deleted volume successfully.
Jun 06 01:09:37 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] Acquiring lock "cinder-quobyte-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:09:37 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-71d9d4e8-ff18-4257-8912-befea58466c6 tempest-VolumesGetTest-1018775238 None] Lock "cinder-fec12fb7-2f86-464d-a431-1eb1c786f1f2-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:09:37 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:09:37 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[6889e8b6-6079-4a16-a54a-80276cdc6a83]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:37 devstack sudo[95272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c
Jun 06 01:09:37 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:38 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c" returned: 0 in 0.722s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:38 devstack sudo[95277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c
Jun 06 01:09:38 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:38 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c" returned: 0 in 0.669s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c" released by "delete_volume" :: held 1.476s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:09:39 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] Created reservations ['1736e611-c534-49de-9578-5a090c5e0445', '5bac8550-aa72-4e94-98a7-ef7f9f5c8a2a', '09bce8a3-15dd-444f-b4d9-0e26abfef57a', '8a8cbb0a-9995-4f48-b1d0-8f5b0cc9b66a'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:09:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:09:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:09:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:39 devstack sudo[95281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:09:39 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:40 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.911s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:40 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:09:40 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] Deleted volume successfully.
Jun 06 01:09:40 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-740734aa-5c38-4c40-84fd-a50dff4d2f48 tempest-VolumesGetTest-1018775238 None] Lock "cinder-5d9ac1f8-416e-44e9-a119-e3df7cbbcf9c-delete_volume" released by "delete_volume" :: held 2.751s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:09:40 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:09:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Flow 'volume_create_manager' (26ce131d-e6ef-4b80-bdfd-394a2d7cdb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:09:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2db393-43a7-4c68-9fe0-b3b104967a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2db393-43a7-4c68-9fe0-b3b104967a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1250685235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='57f5c4ca37aa4ecea394b3d70489c57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:09:41Z,use_quota=True,user_id='4fc74b005a0744f8a280f8bdd0fba220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186190f4-9053-45d0-86b7-752ab45bcc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186190f4-9053-45d0-86b7-752ab45bcc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be983ec-5166-4d86-99e4-1c391f031612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:40 devstack cinder-volume[86581]: DEBUG cinder.image.glance [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Creating Keystone auth plugin from conf {{(pid=86581) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 06 01:09:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be983ec-5166-4d86-99e4-1c391f031612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0', 'volume_name': 'volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0', 'volume_size': 1, 'image_id': '072119e4-dec9-4da3-882b-9b4b26824482', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30202bd94f9947968da8019925562da0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '072119e4-dec9-4da3-882b-9b4b26824482', 'created_at': datetime.datetime(2026, 6, 5, 22, 55, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 22, 55, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072119e4-dec9-4da3-882b-9b4b26824482/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2c9eba0>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58430ca7-b1f3-4e0e-b431-6d7372ea9cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58430ca7-b1f3-4e0e-b431-6d7372ea9cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af887cc7-3be9-4aff-94a5-612ea117082e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:41 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Volume cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0', 'volume_size': 1, 'image_id': '072119e4-dec9-4da3-882b-9b4b26824482', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30202bd94f9947968da8019925562da0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '072119e4-dec9-4da3-882b-9b4b26824482', 'created_at': datetime.datetime(2026, 6, 5, 22, 55, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 22, 55, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072119e4-dec9-4da3-882b-9b4b26824482/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2c9eba0>}
Jun 06 01:09:41 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Trying to clone cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 from image 072119e4-dec9-4da3-882b-9b4b26824482 at location (None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}]). {{(pid=86581) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Jun 06 01:09:41 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_yez_knhwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jun 06 01:09:41 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Image download 20.69 MB at 20.69 MB/s
Jun 06 01:09:41 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[24778aeb-fdce-41ff-a903-f17406fbb770]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_yez_knhwdevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:41 devstack sudo[95336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_yez_knhwdevstack@QuobyteHD
Jun 06 01:09:41 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:42 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_yez_knhwdevstack@QuobyteHD" returned: 0 in 1.048s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:42 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Temporary image 072119e4-dec9-4da3-882b-9b4b26824482 is fetched for user 4fc74b005a0744f8a280f8bdd0fba220. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jun 06 01:09:42 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab57131b-9f2f-4e96-8a59-2af3c7503795]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_yez_knhwdevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:43 devstack sudo[95344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_yez_knhwdevstack@QuobyteHD
Jun 06 01:09:43 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:43 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_yez_knhwdevstack@QuobyteHD" returned: 0 in 0.777s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1250685235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='57f5c4ca37aa4ecea394b3d70489c57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:09:41Z,use_quota=True,user_id='4fc74b005a0744f8a280f8bdd0fba220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:09:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Creating volume cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:09:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:09:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:09:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:09:43 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:09:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:43 devstack sudo[95350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 1073741824
Jun 06 01:09:43 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:44 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 1073741824" returned: 0 in 0.897s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:44 devstack sudo[95360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0
Jun 06 01:09:44 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:45 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0" returned: 0 in 0.704s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:09:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:45 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Attempting download of 072119e4-dec9-4da3-882b-9b4b26824482 ((None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}])) to volume cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jun 06 01:09:45 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b897df2-b63b-4082-996f-41df7e75bb83]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_p6t3zfe4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:45 devstack sudo[95366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_p6t3zfe4
Jun 06 01:09:45 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:46 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_p6t3zfe4" returned: 0 in 0.712s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_p6t3zfe4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:46 devstack sudo[95371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_p6t3zfe4
Jun 06 01:09:46 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:46 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_p6t3zfe4" returned: 1 in 0.709s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_p6t3zfe4' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:09:46 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9105af2-dc08-4797-b27c-f90d9a92c6d4]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_yez_knhwdevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:46 devstack sudo[95377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_yez_knhwdevstack@QuobyteHD
Jun 06 01:09:46 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-33ad4b0b-bafa-428c-8e89-67303ccfdd67 req-bbe6d8ac-2038-43b5-9511-ffd0103d486d tempest-TestServerVolumeAttachmentScenario-531005618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-33ad4b0b-bafa-428c-8e89-67303ccfdd67 req-bbe6d8ac-2038-43b5-9511-ffd0103d486d tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:47 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bba65c-ae37-4a89-9e6a-ab5421fd24bd]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-33ad4b0b-bafa-428c-8e89-67303ccfdd67 req-bbe6d8ac-2038-43b5-9511-ffd0103d486d tempest-TestServerVolumeAttachmentScenario-531005618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a513d5e4-ef61-429d-aba5-e51ec92f471a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:47 devstack sudo[95387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a513d5e4-ef61-429d-aba5-e51ec92f471a
Jun 06 01:09:47 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:47 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_yez_knhwdevstack@QuobyteHD" returned: 0 in 0.700s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:47 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] 072119e4-dec9-4da3-882b-9b4b26824482 was qcow2, converting to raw {{(pid=86581) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jun 06 01:09:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_yez_knhwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:47 devstack sudo[95393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_yez_knhwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0
Jun 06 01:09:47 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:48 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-33ad4b0b-bafa-428c-8e89-67303ccfdd67 req-bbe6d8ac-2038-43b5-9511-ffd0103d486d tempest-TestServerVolumeAttachmentScenario-531005618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a513d5e4-ef61-429d-aba5-e51ec92f471a" returned: 0 in 0.784s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-33ad4b0b-bafa-428c-8e89-67303ccfdd67 req-bbe6d8ac-2038-43b5-9511-ffd0103d486d tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.805s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-33ad4b0b-bafa-428c-8e89-67303ccfdd67 req-bbe6d8ac-2038-43b5-9511-ffd0103d486d tempest-TestServerVolumeAttachmentScenario-531005618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-a513d5e4-ef61-429d-aba5-e51ec92f471a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '140e08da-cc71-493e-a2dd-bbc27861a863', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:09:48 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-33ad4b0b-bafa-428c-8e89-67303ccfdd67 req-bbe6d8ac-2038-43b5-9511-ffd0103d486d tempest-TestServerVolumeAttachmentScenario-531005618 None] attachment_update completed successfully.
Jun 06 01:09:49 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_yez_knhwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0" returned: 0 in 2.060s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:49 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_yez_knhwdevstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:09:49 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Converted 112.00 MB image at 54.34 MB/s
Jun 06 01:09:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:49 devstack sudo[95413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 1G
Jun 06 01:09:49 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:50 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 1G" returned: 0 in 0.721s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:50 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[37797ebb-f320-45b4-b043-ec4052384538]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:50 devstack sudo[95421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0
Jun 06 01:09:50 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:51 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0" returned: 0 in 0.808s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:51 devstack sudo[95431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0
Jun 06 01:09:51 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:52 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0" returned: 1 in 1.190s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:09:52 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Downloaded image 072119e4-dec9-4da3-882b-9b4b26824482 ((None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}])) to volume cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 successfully. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jun 06 01:09:52 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Temporary image 072119e4-dec9-4da3-882b-9b4b26824482 for user 4fc74b005a0744f8a280f8bdd0fba220 is deleted. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jun 06 01:09:52 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Marking volume cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 as bootable. {{(pid=86581) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jun 06 01:09:52 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Copying metadata from image 072119e4-dec9-4da3-882b-9b4b26824482 to cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0. {{(pid=86581) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 06 01:09:52 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Creating volume glance metadata for volume cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 backed by image 072119e4-dec9-4da3-882b-9b4b26824482 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '072119e4-dec9-4da3-882b-9b4b26824482', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86581) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 06 01:09:52 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af887cc7-3be9-4aff-94a5-612ea117082e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0', 'volume_size': 1, 'image_id': '072119e4-dec9-4da3-882b-9b4b26824482', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30202bd94f9947968da8019925562da0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '072119e4-dec9-4da3-882b-9b4b26824482', 'created_at': datetime.datetime(2026, 6, 5, 22, 55, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 22, 55, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072119e4-dec9-4da3-882b-9b4b26824482/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2c9eba0>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:52 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7017ec-6588-40a3-b85d-1b8607c4252b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:52 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Volume volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 (cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0): created successfully
Jun 06 01:09:52 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7017ec-6588-40a3-b85d-1b8607c4252b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:52 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Flow 'volume_create_manager' (26ce131d-e6ef-4b80-bdfd-394a2d7cdb82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:09:52 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-754f8f2c-e4b9-4ab9-a248-d40a9864e4e0 tempest-VolumesGetTest-1018775238 None] Created volume successfully.
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Flow 'volume_create_manager' (191c14dc-dbbc-4868-b96a-a6bb9a128e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f38554-b441-4292-9cea-25b4d1677bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f38554-b441-4292-9cea-25b4d1677bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:09:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-9777766',display_name='tempest-VolumesGetTest-Volume-1093915132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f21bbd-8d17-4732-a64f-fde0acf8a492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f5c4ca37aa4ecea394b3d70489c57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:09:54Z,use_quota=True,user_id='4fc74b005a0744f8a280f8bdd0fba220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64d7585-f480-44e8-9dc4-5911a8c153b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64d7585-f480-44e8-9dc4-5911a8c153b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e204d1-1c69-4330-9a19-df85172d9a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e204d1-1c69-4330-9a19-df85172d9a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f21bbd-8d17-4732-a64f-fde0acf8a492', 'volume_name': 'volume-25f21bbd-8d17-4732-a64f-fde0acf8a492', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aeb98a6-b76f-4520-8169-13825adb0a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aeb98a6-b76f-4520-8169-13825adb0a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8c92c4-9918-44d4-9123-5dbfe1818c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:54 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Volume 25f21bbd-8d17-4732-a64f-fde0acf8a492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f21bbd-8d17-4732-a64f-fde0acf8a492', 'volume_size': 1}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:09:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-9777766',display_name='tempest-VolumesGetTest-Volume-1093915132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f21bbd-8d17-4732-a64f-fde0acf8a492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f5c4ca37aa4ecea394b3d70489c57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:09:54Z,use_quota=True,user_id='4fc74b005a0744f8a280f8bdd0fba220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Creating volume 25f21bbd-8d17-4732-a64f-fde0acf8a492 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:09:54 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:09:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-25f21bbd-8d17-4732-a64f-fde0acf8a492 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:54 devstack sudo[95525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-25f21bbd-8d17-4732-a64f-fde0acf8a492 1073741824
Jun 06 01:09:54 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:55 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-8e792f0b-5034-4f2e-8466-b66b77c73f71 req-ae8afaba-f61c-4bce-b72b-a38fdb0df2a9 tempest-TestServerVolumeAttachmentScenario-531005618 None] Terminate volume connection completed successfully.
Jun 06 01:09:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-8e792f0b-5034-4f2e-8466-b66b77c73f71 req-ae8afaba-f61c-4bce-b72b-a38fdb0df2a9 tempest-TestServerVolumeAttachmentScenario-531005618 None] Deleting attachment 140e08da-cc71-493e-a2dd-bbc27861a863. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:09:55 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-25f21bbd-8d17-4732-a64f-fde0acf8a492 1073741824" returned: 0 in 0.990s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-25f21bbd-8d17-4732-a64f-fde0acf8a492 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:55 devstack sudo[95560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-25f21bbd-8d17-4732-a64f-fde0acf8a492
Jun 06 01:09:55 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:56 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-25f21bbd-8d17-4732-a64f-fde0acf8a492" returned: 0 in 0.650s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:09:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8c92c4-9918-44d4-9123-5dbfe1818c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f21bbd-8d17-4732-a64f-fde0acf8a492', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34417c3-0889-466f-97d0-14ba43562186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:09:56 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Volume volume-25f21bbd-8d17-4732-a64f-fde0acf8a492 (25f21bbd-8d17-4732-a64f-fde0acf8a492): created successfully
Jun 06 01:09:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34417c3-0889-466f-97d0-14ba43562186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:09:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Flow 'volume_create_manager' (191c14dc-dbbc-4868-b96a-a6bb9a128e58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:09:56 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-aed33b08-531a-42fc-a5a7-adba77d62492 tempest-VolumesGetTest-1018775238 None] Created volume successfully.
Jun 06 01:09:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] Acquiring lock "cinder-25f21bbd-8d17-4732-a64f-fde0acf8a492-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:09:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] Lock "cinder-25f21bbd-8d17-4732-a64f-fde0acf8a492-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:09:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] Acquiring lock "cinder-quobyte-25f21bbd-8d17-4732-a64f-fde0acf8a492" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:09:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-25f21bbd-8d17-4732-a64f-fde0acf8a492" acquired by "delete_volume" :: waited 0.025s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:09:57 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[e271eaba-4385-470f-838f-80675bebd70b]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:09:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-25f21bbd-8d17-4732-a64f-fde0acf8a492 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:57 devstack sudo[95612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-25f21bbd-8d17-4732-a64f-fde0acf8a492
Jun 06 01:09:57 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:58 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-25f21bbd-8d17-4732-a64f-fde0acf8a492" returned: 0 in 1.267s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-25f21bbd-8d17-4732-a64f-fde0acf8a492 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:58 devstack sudo[95633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-25f21bbd-8d17-4732-a64f-fde0acf8a492
Jun 06 01:09:58 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:59 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root
Jun 06 01:09:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-25f21bbd-8d17-4732-a64f-fde0acf8a492" returned: 0 in 0.701s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:09:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-25f21bbd-8d17-4732-a64f-fde0acf8a492" released by "delete_volume" :: held 2.058s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:09:59 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] Created reservations ['eb72c39d-422d-4f9f-8ca3-0d13fe406f75', '6ec6d705-2a7b-4f69-a6d1-d50ebf2c48e7', '079866f3-1641-4105-ae07-372e557cd9c0', '4af7122d-538f-4163-b063-3e7c8d65120b'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:09:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:09:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:09:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:09:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:09:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:09:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:09:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:09:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:09:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:09:59 devstack sudo[95636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:09:59 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:09:59 devstack sudo[95638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:09:59 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:00 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.827s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:10:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Acquiring lock "cinder-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:00 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Lock "cinder-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.150s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:10:00 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] Deleted volume successfully.
Jun 06 01:10:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0050974f-667e-46c2-9323-c9c189329de0 tempest-VolumesGetTest-1018775238 None] Lock "cinder-25f21bbd-8d17-4732-a64f-fde0acf8a492-delete_volume" released by "delete_volume" :: held 3.563s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Acquiring lock "cinder-quobyte-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0" acquired by "delete_volume" :: waited 0.026s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:00 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e2cede-5a95-4f14-a3f7-16b8ce700499]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:10:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:00 devstack sudo[95644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0
Jun 06 01:10:00 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:01 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-9f4adc39-1dd1-4098-bdac-0f16c7185e64 req-f6d8d1da-6706-4efc-8f88-754971b636fd tempest-TestServerVolumeAttachmentScenario-531005618 None] Terminate volume connection completed successfully.
Jun 06 01:10:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-9f4adc39-1dd1-4098-bdac-0f16c7185e64 req-f6d8d1da-6706-4efc-8f88-754971b636fd tempest-TestServerVolumeAttachmentScenario-531005618 None] Deleting attachment e3e9435a-ede1-4a33-9561-f0e2ea5807a4. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:10:01 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0" returned: 0 in 1.159s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:01 devstack sudo[95650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0
Jun 06 01:10:01 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:02 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0" returned: 1 in 1.002s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:10:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:02 devstack sudo[95660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0
Jun 06 01:10:02 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:03 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0" returned: 0 in 0.691s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Lock "cinder-quobyte-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0" released by "delete_volume" :: held 2.964s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:03 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Created reservations ['c6e7efa4-8f67-4095-b9a3-f27e8c226d52', '47f77840-ecb9-49be-83fa-93cbe70a3a60', '7e6dd1fc-b894-4d2d-a22b-8ae18d95eaa4', '9a207097-577b-4f26-8cca-e161d6a62d74'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:10:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:03 devstack sudo[95664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:10:03 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:04 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.087s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:04 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:10:04 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Deleted volume successfully.
Jun 06 01:10:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c12ed361-6247-4da8-8420-353a69b16fb6 tempest-VolumesGetTest-1018775238 None] Lock "cinder-cffdd6bd-c0f5-4bfd-bc54-537b2253a9b0-delete_volume" released by "delete_volume" :: held 4.524s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Flow 'volume_create_manager' (0b770a9f-362d-494a-8d7e-c251bc669c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd214f81-349f-4e1b-b7f5-ea553983e3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd214f81-349f-4e1b-b7f5-ea553983e3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2021894622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36e7f18-7832-445c-b037-af8090b9f8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1347e24faf07468fb0484ea0c51dabf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:10:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:10:08Z,use_quota=True,user_id='d9ac7bb855574e17a6bf543561340983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4c3cb9-1609-4742-8362-268d3c8edb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4c3cb9-1609-4742-8362-268d3c8edb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c750bd5-1105-4275-a981-6b099c7eb6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c750bd5-1105-4275-a981-6b099c7eb6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b36e7f18-7832-445c-b037-af8090b9f8d4', 'volume_name': 'volume-b36e7f18-7832-445c-b037-af8090b9f8d4', 'volume_size': 2}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21566ae-d048-4ae8-ab8a-9e2c4700e209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21566ae-d048-4ae8-ab8a-9e2c4700e209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6ed8d1-98be-492b-a33c-77018cf95113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:08 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Volume b36e7f18-7832-445c-b037-af8090b9f8d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b36e7f18-7832-445c-b037-af8090b9f8d4', 'volume_size': 2}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2021894622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36e7f18-7832-445c-b037-af8090b9f8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1347e24faf07468fb0484ea0c51dabf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:10:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:10:08Z,use_quota=True,user_id='d9ac7bb855574e17a6bf543561340983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Creating volume b36e7f18-7832-445c-b037-af8090b9f8d4 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:10:08 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:10:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4 2147483648 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:08 devstack sudo[95727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4 2147483648
Jun 06 01:10:08 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:09 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4 2147483648" returned: 0 in 0.920s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:09 devstack sudo[95755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4
Jun 06 01:10:09 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:10 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4" returned: 0 in 0.632s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:10:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6ed8d1-98be-492b-a33c-77018cf95113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b36e7f18-7832-445c-b037-af8090b9f8d4', 'volume_size': 2}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40dc7c9-120f-4750-832f-47251751857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:10 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Volume volume-b36e7f18-7832-445c-b037-af8090b9f8d4 (b36e7f18-7832-445c-b037-af8090b9f8d4): created successfully
Jun 06 01:10:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40dc7c9-120f-4750-832f-47251751857c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Flow 'volume_create_manager' (0b770a9f-362d-494a-8d7e-c251bc669c03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:10:10 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d5494439-af69-4b5b-a663-c924cda5ac9c tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Created volume successfully.
Jun 06 01:10:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Creating offline snapshot 4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053 of volume b36e7f18-7832-445c-b037-af8090b9f8d4 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:10:10 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b46bf0d-58f5-4b49-8f14-9009f9c2ba9b]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:10:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:10 devstack sudo[95758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4
Jun 06 01:10:10 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:11 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4" returned: 0 in 0.831s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053 2G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:11 devstack sudo[95763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053 2G
Jun 06 01:10:11 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] Acquiring lock "cinder-a513d5e4-ef61-429d-aba5-e51ec92f471a-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "cinder-a513d5e4-ef61-429d-aba5-e51ec92f471a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] Acquiring lock "cinder-quobyte-a513d5e4-ef61-429d-aba5-e51ec92f471a" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "cinder-quobyte-a513d5e4-ef61-429d-aba5-e51ec92f471a" acquired by "delete_volume" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:12 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[de55df25-5518-40a2-a931-b734e8e1e5c8]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:10:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a513d5e4-ef61-429d-aba5-e51ec92f471a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:12 devstack sudo[95792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a513d5e4-ef61-429d-aba5-e51ec92f471a
Jun 06 01:10:12 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:12 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053 2G" returned: 0 in 0.862s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b36e7f18-7832-445c-b037-af8090b9f8d4 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:12 devstack sudo[95795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b36e7f18-7832-445c-b037-af8090b9f8d4 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053
Jun 06 01:10:12 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:13 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a513d5e4-ef61-429d-aba5-e51ec92f471a" returned: 0 in 0.807s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a513d5e4-ef61-429d-aba5-e51ec92f471a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:13 devstack sudo[95804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a513d5e4-ef61-429d-aba5-e51ec92f471a
Jun 06 01:10:13 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:13 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b36e7f18-7832-445c-b037-af8090b9f8d4 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053" returned: 0 in 0.752s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:13 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053 is being set with open permissions: ugo+rw
Jun 06 01:10:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:13 devstack sudo[95806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053
Jun 06 01:10:13 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:13 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a513d5e4-ef61-429d-aba5-e51ec92f471a" returned: 0 in 0.686s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "cinder-quobyte-a513d5e4-ef61-429d-aba5-e51ec92f471a" released by "delete_volume" :: held 1.533s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:13 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053" returned: 0 in 0.655s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:13 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] Created reservations ['bf314994-7445-4d19-852e-7f78532a5092', '553e8612-c122-4e96-a72e-3fabf5959071', 'b8db0e89-d9ba-4afc-b899-89f818b180ba', '2e3ee1c4-306c-4771-bcee-416c44313839'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:10:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:14 devstack sudo[95810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.info
Jun 06 01:10:14 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:14 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:14 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:14 devstack sudo[95812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:10:14 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] Acquiring lock "cinder-121cfdad-1228-444b-8c59-e5b970587f42-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "cinder-121cfdad-1228-444b-8c59-e5b970587f42-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:14 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.info" returned: 0 in 0.625s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:14 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.info is being set with open permissions: ugo+rw
Jun 06 01:10:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:14 devstack sudo[95816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.info
Jun 06 01:10:14 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] Acquiring lock "cinder-quobyte-121cfdad-1228-444b-8c59-e5b970587f42" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "cinder-quobyte-121cfdad-1228-444b-8c59-e5b970587f42" acquired by "delete_volume" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:14 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.633s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:14 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:10:14 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] Deleted volume successfully.
Jun 06 01:10:14 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be1767a-7f18-4b14-bd02-746d0b82b43b]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:10:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-121cfdad-1228-444b-8c59-e5b970587f42 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e62da2ad-d19c-4d78-8ab7-a5348d64e790 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "cinder-a513d5e4-ef61-429d-aba5-e51ec92f471a-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:14 devstack sudo[95818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-121cfdad-1228-444b-8c59-e5b970587f42
Jun 06 01:10:14 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:15 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.info" returned: 0 in 0.622s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.447s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:15 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-efc02696-82ea-42f3-84df-639e295d2fb0 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Create snapshot completed successfully
Jun 06 01:10:15 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-121cfdad-1228-444b-8c59-e5b970587f42" returned: 0 in 0.717s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-121cfdad-1228-444b-8c59-e5b970587f42 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:15 devstack sudo[95824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-121cfdad-1228-444b-8c59-e5b970587f42
Jun 06 01:10:15 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:16 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Acquiring lock "cinder-4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-121cfdad-1228-444b-8c59-e5b970587f42" returned: 0 in 0.679s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "cinder-quobyte-121cfdad-1228-444b-8c59-e5b970587f42" released by "delete_volume" :: held 1.461s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "cinder-4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Acquiring lock "cinder-quobyte-b36e7f18-7832-445c-b037-af8090b9f8d4" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "cinder-quobyte-b36e7f18-7832-445c-b037-af8090b9f8d4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Acquiring lock "cinder-quobyte-4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "cinder-quobyte-4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Deleting offline snapshot 4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053 of volume b36e7f18-7832-445c-b037-af8090b9f8d4 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] snapshot_file for this snap is: volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a361f8-b278-4fb6-9e45-b32f188a5c8b]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] Created reservations ['c2a2b5b1-15ac-4c87-a0f7-43b4b9207b05', 'd2da23f0-138c-4876-8622-f8c947b01fde', 'eeaed7ca-8dec-49e9-9e61-52b20512d387', 'eeebd014-7f3e-4dc7-bf18-516d006146b4'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:16 devstack sudo[95836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053
Jun 06 01:10:16 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:16 devstack sudo[95837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:10:16 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:16 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053" returned: 0 in 0.755s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b36e7f18-7832-445c-b037-af8090b9f8d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:10:16 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.694s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:17 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:10:17 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] Deleted volume successfully.
Jun 06 01:10:17 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b1afeb-a0a9-4f3e-95b7-37a7a75daec8]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:10:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6e25ff5e-a68d-4207-b0d0-27aab98064b7 tempest-TestServerVolumeAttachmentScenario-531005618 None] Lock "cinder-121cfdad-1228-444b-8c59-e5b970587f42-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:17 devstack sudo[95845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4
Jun 06 01:10:17 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:17 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-7c91e76b-827c-46e9-9d0d-cdb1f24f6539 req-e0f5afb3-2288-4e8c-a475-6bb38b1f52f8 tempest-AttachVolumeTestJSON-25463068 None] Terminate volume connection completed successfully.
Jun 06 01:10:17 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-7c91e76b-827c-46e9-9d0d-cdb1f24f6539 req-e0f5afb3-2288-4e8c-a475-6bb38b1f52f8 tempest-AttachVolumeTestJSON-25463068 None] Deleting attachment c3b67276-a553-4841-987e-0d4b14f63c3e. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:10:17 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4" returned: 0 in 0.763s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:17 devstack sudo[95853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053
Jun 06 01:10:17 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:18 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053" returned: 0 in 0.922s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:18 devstack sudo[95860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053
Jun 06 01:10:18 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:19 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4.4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053" returned: 0 in 0.630s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "cinder-quobyte-4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053" released by "_delete_snapshot" :: held 3.236s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "cinder-quobyte-b36e7f18-7832-445c-b037-af8090b9f8d4" released by "delete_snapshot" :: held 3.261s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:19 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Created reservations ['f51631c1-0878-4d97-9dee-f21055e86c4c', '70a1b86d-ab91-4bca-b4ec-f5e1d0b702bc', '84043c81-846e-4a85-bd2d-7aae94bce1f6', '281ef2f7-bcb7-4683-9a6e-9c8042e789f6'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:10:19 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Delete snapshot completed successfully.
Jun 06 01:10:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1fe070d4-d8ab-45bd-9015-f930ee0261c9 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "cinder-4ac7a34b-9fe0-4f4c-b962-7ce8ffa29053-delete_snapshot" released by "delete_snapshot" :: held 3.414s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Acquiring lock "cinder-b36e7f18-7832-445c-b037-af8090b9f8d4-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "cinder-b36e7f18-7832-445c-b037-af8090b9f8d4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Acquiring lock "cinder-quobyte-b36e7f18-7832-445c-b037-af8090b9f8d4" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "cinder-quobyte-b36e7f18-7832-445c-b037-af8090b9f8d4" acquired by "delete_volume" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:20 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b2f9ce-7a19-4f52-a805-89d03a543428]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:10:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:20 devstack sudo[95898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4
Jun 06 01:10:20 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:21 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4" returned: 0 in 1.062s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:21 devstack sudo[95905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4
Jun 06 01:10:21 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:22 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b36e7f18-7832-445c-b037-af8090b9f8d4" returned: 0 in 0.667s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "cinder-quobyte-b36e7f18-7832-445c-b037-af8090b9f8d4" released by "delete_volume" :: held 1.814s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:22 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Created reservations ['0e25628b-6b35-45ea-b7e2-6d687a6fe3fb', '80841663-1146-4ec3-a754-9fe3afa823f9', '6adc17a2-f52d-4246-90db-284ff9aaf828', '4397ad48-aa27-4e53-935d-f6da8cdeadc9'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:10:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:22 devstack sudo[95910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:10:22 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:22 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:10:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Flow 'volume_create_manager' (598ae099-fa3c-4bd4-bf28-cd180a8a5852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:10:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f53bd9d-7c14-44bc-94ea-337b6dfe9fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f53bd9d-7c14-44bc-94ea-337b6dfe9fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1989401659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9094056f-5dd1-454e-a99a-2f446406dfa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54037968ce94bf9a9d1162ad5e945c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:10:23Z,use_quota=True,user_id='616a9e99d38846d580ff738ea76311ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12bd75da-26f4-4bf1-8a91-7deb6f8174f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12bd75da-26f4-4bf1-8a91-7deb6f8174f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b225e37b-7915-4aa1-9e44-04293d5c3974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b225e37b-7915-4aa1-9e44-04293d5c3974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9094056f-5dd1-454e-a99a-2f446406dfa7', 'volume_name': 'volume-9094056f-5dd1-454e-a99a-2f446406dfa7', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c4113c-beda-4314-8f1f-b5494ca73c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c4113c-beda-4314-8f1f-b5494ca73c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47add42c-9234-4519-8b6a-710a75ada3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:23 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Volume 9094056f-5dd1-454e-a99a-2f446406dfa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9094056f-5dd1-454e-a99a-2f446406dfa7', 'volume_size': 1}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1989401659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9094056f-5dd1-454e-a99a-2f446406dfa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54037968ce94bf9a9d1162ad5e945c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:10:23Z,use_quota=True,user_id='616a9e99d38846d580ff738ea76311ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Creating volume 9094056f-5dd1-454e-a99a-2f446406dfa7 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:10:23 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9094056f-5dd1-454e-a99a-2f446406dfa7 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:23 devstack sudo[95913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9094056f-5dd1-454e-a99a-2f446406dfa7 1073741824
Jun 06 01:10:23 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:23 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.967s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:10:23 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Deleted volume successfully.
Jun 06 01:10:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ef6f1b7e-03ca-472d-a9eb-b677faa088d3 tempest-VolumesSnapshotNegativeTestJSON-708260979 None] Lock "cinder-b36e7f18-7832-445c-b037-af8090b9f8d4-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:24 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9094056f-5dd1-454e-a99a-2f446406dfa7 1073741824" returned: 0 in 1.065s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9094056f-5dd1-454e-a99a-2f446406dfa7 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:24 devstack sudo[95922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9094056f-5dd1-454e-a99a-2f446406dfa7
Jun 06 01:10:24 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:25 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9094056f-5dd1-454e-a99a-2f446406dfa7" returned: 0 in 0.905s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:25 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:10:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47add42c-9234-4519-8b6a-710a75ada3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9094056f-5dd1-454e-a99a-2f446406dfa7', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186276d4-0d0d-41cf-9f77-a7412eea6c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:25 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Volume volume-9094056f-5dd1-454e-a99a-2f446406dfa7 (9094056f-5dd1-454e-a99a-2f446406dfa7): created successfully
Jun 06 01:10:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186276d4-0d0d-41cf-9f77-a7412eea6c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Flow 'volume_create_manager' (598ae099-fa3c-4bd4-bf28-cd180a8a5852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:10:25 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-37d47407-d4c4-473f-bacc-7f0980a8914b tempest-AttachVolumeNegativeTest-1679390173 None] Created volume successfully.
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Flow 'volume_create_manager' (abf147dc-ae48-4744-bec2-2a366592bc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1087f42-8a1a-4f77-821f-68a8c1be5c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1087f42-8a1a-4f77-821f-68a8c1be5c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-326164895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f970507-74c1-4f97-804f-373c22bd7389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bdff5ad0be485bb2d0b14142b79b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:10:29Z,use_quota=True,user_id='33fffa1284824ff081582edf2736ad5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da032ae-f1c7-4488-bbce-90b878c929b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da032ae-f1c7-4488-bbce-90b878c929b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea43b80-1760-4232-91f6-02d9291c5a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea43b80-1760-4232-91f6-02d9291c5a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f970507-74c1-4f97-804f-373c22bd7389', 'volume_name': 'volume-7f970507-74c1-4f97-804f-373c22bd7389', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019b4d59-2106-4a96-b28f-be7d70d2563f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019b4d59-2106-4a96-b28f-be7d70d2563f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7268723c-f18f-42fa-b33c-b91f527e1387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:29 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume 7f970507-74c1-4f97-804f-373c22bd7389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f970507-74c1-4f97-804f-373c22bd7389', 'volume_size': 1}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-326164895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f970507-74c1-4f97-804f-373c22bd7389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bdff5ad0be485bb2d0b14142b79b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:10:29Z,use_quota=True,user_id='33fffa1284824ff081582edf2736ad5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Creating volume 7f970507-74c1-4f97-804f-373c22bd7389 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:10:29 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f970507-74c1-4f97-804f-373c22bd7389 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:29 devstack sudo[95942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f970507-74c1-4f97-804f-373c22bd7389 1073741824
Jun 06 01:10:29 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-e05f9afc-e437-432e-8c25-d81d78625e74 req-2068f7d8-7535-4c4c-ab43-f080b1bef7b3 tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:30 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f970507-74c1-4f97-804f-373c22bd7389 1073741824" returned: 0 in 0.939s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f970507-74c1-4f97-804f-373c22bd7389 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:30 devstack sudo[95960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f970507-74c1-4f97-804f-373c22bd7389
Jun 06 01:10:30 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:31 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f970507-74c1-4f97-804f-373c22bd7389" returned: 0 in 0.832s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:10:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-e05f9afc-e437-432e-8c25-d81d78625e74 req-2068f7d8-7535-4c4c-ab43-f080b1bef7b3 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.580s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7268723c-f18f-42fa-b33c-b91f527e1387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f970507-74c1-4f97-804f-373c22bd7389', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4473d8d-531b-43c0-95f8-70c6fd9c321e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:31 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41c9f67-1c89-41e8-9c01-5a2a5d2aca4c]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:10:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-e05f9afc-e437-432e-8c25-d81d78625e74 req-2068f7d8-7535-4c4c-ab43-f080b1bef7b3 tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9094056f-5dd1-454e-a99a-2f446406dfa7 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:31 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume volume-7f970507-74c1-4f97-804f-373c22bd7389 (7f970507-74c1-4f97-804f-373c22bd7389): created successfully
Jun 06 01:10:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4473d8d-531b-43c0-95f8-70c6fd9c321e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Flow 'volume_create_manager' (abf147dc-ae48-4744-bec2-2a366592bc89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:10:31 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-716592db-f93c-414d-8379-3f82d13b3baf tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Created volume successfully.
Jun 06 01:10:31 devstack sudo[95998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9094056f-5dd1-454e-a99a-2f446406dfa7
Jun 06 01:10:31 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:32 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Flow 'volume_create_manager' (8575e2bc-ad38-4a7d-8f63-34416406dc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ebd6ff-fa4a-4796-9952-c6b4b9340387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-e05f9afc-e437-432e-8c25-d81d78625e74 req-2068f7d8-7535-4c4c-ab43-f080b1bef7b3 tempest-AttachVolumeNegativeTest-1679390173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9094056f-5dd1-454e-a99a-2f446406dfa7" returned: 0 in 1.143s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-e05f9afc-e437-432e-8c25-d81d78625e74 req-2068f7d8-7535-4c4c-ab43-f080b1bef7b3 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.191s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ebd6ff-fa4a-4796-9952-c6b4b9340387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1558230520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602764a2-285c-4bbb-ba4d-33e8d9d29163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bdff5ad0be485bb2d0b14142b79b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:10:32Z,use_quota=True,user_id='33fffa1284824ff081582edf2736ad5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3044d7-4ece-49a3-a03a-ee0cf0b052b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3044d7-4ece-49a3-a03a-ee0cf0b052b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f82ed29c-8359-4b6c-b313-29d1647ec291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f82ed29c-8359-4b6c-b313-29d1647ec291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602764a2-285c-4bbb-ba4d-33e8d9d29163', 'volume_name': 'volume-602764a2-285c-4bbb-ba4d-33e8d9d29163', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28ba3f8-3194-4289-ad83-ae4b32941671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28ba3f8-3194-4289-ad83-ae4b32941671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efedf26-8665-4423-b38a-bdfa77c2881d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:32 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume 602764a2-285c-4bbb-ba4d-33e8d9d29163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602764a2-285c-4bbb-ba4d-33e8d9d29163', 'volume_size': 1}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1558230520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602764a2-285c-4bbb-ba4d-33e8d9d29163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bdff5ad0be485bb2d0b14142b79b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:10:32Z,use_quota=True,user_id='33fffa1284824ff081582edf2736ad5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Creating volume 602764a2-285c-4bbb-ba4d-33e8d9d29163 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:10:32 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-602764a2-285c-4bbb-ba4d-33e8d9d29163 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:32 devstack sudo[96033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-602764a2-285c-4bbb-ba4d-33e8d9d29163 1073741824
Jun 06 01:10:32 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-e05f9afc-e437-432e-8c25-d81d78625e74 req-2068f7d8-7535-4c4c-ab43-f080b1bef7b3 tempest-AttachVolumeNegativeTest-1679390173 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-9094056f-5dd1-454e-a99a-2f446406dfa7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '436e8331-3425-4e47-afea-882d287967cd', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:10:32 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-e05f9afc-e437-432e-8c25-d81d78625e74 req-2068f7d8-7535-4c4c-ab43-f080b1bef7b3 tempest-AttachVolumeNegativeTest-1679390173 None] attachment_update completed successfully.
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Flow 'volume_create_manager' (c1abe8d0-ec37-41d2-a601-c27737641da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d795da0c-9337-48ba-bb78-6445a17a1846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d795da0c-9337-48ba-bb78-6445a17a1846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-282127066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f3ebb5-05bd-439e-be9b-c9c5dcad6677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bdff5ad0be485bb2d0b14142b79b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:10:33Z,use_quota=True,user_id='33fffa1284824ff081582edf2736ad5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d17bae-fb2c-4e8e-9ced-f83ed5b8a315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d17bae-fb2c-4e8e-9ced-f83ed5b8a315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca315826-41b7-4704-9fe9-b6a3c8908167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca315826-41b7-4704-9fe9-b6a3c8908167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93f3ebb5-05bd-439e-be9b-c9c5dcad6677', 'volume_name': 'volume-93f3ebb5-05bd-439e-be9b-c9c5dcad6677', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad21f588-62d4-4752-91e7-5ecca5a77615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad21f588-62d4-4752-91e7-5ecca5a77615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760a3a31-36a0-4182-9026-ffaa0eeb935c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:33 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume 93f3ebb5-05bd-439e-be9b-c9c5dcad6677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93f3ebb5-05bd-439e-be9b-c9c5dcad6677', 'volume_size': 1}
Jun 06 01:10:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:33 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:10:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Flow 'volume_create_manager' (cc2376da-3210-416a-ab6c-f249370e6c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:10:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aaf72f4-fd8e-4fcb-9ece-51fdf87c69e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aaf72f4-fd8e-4fcb-9ece-51fdf87c69e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-618078303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a363358-5a51-4c18-a55d-e079a4c91de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bdff5ad0be485bb2d0b14142b79b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:10:33Z,use_quota=True,user_id='33fffa1284824ff081582edf2736ad5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc3298b-89af-4cfa-9121-1cb699651657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc3298b-89af-4cfa-9121-1cb699651657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad0ee48-55be-40a0-99c2-23dec749493d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad0ee48-55be-40a0-99c2-23dec749493d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a363358-5a51-4c18-a55d-e079a4c91de8', 'volume_name': 'volume-0a363358-5a51-4c18-a55d-e079a4c91de8', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (305b46ae-244c-4c7d-982c-491e8d3be2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (305b46ae-244c-4c7d-982c-491e8d3be2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e832919f-de74-4779-9f40-c5f46521a0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:33 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume 0a363358-5a51-4c18-a55d-e079a4c91de8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a363358-5a51-4c18-a55d-e079a4c91de8', 'volume_size': 1}
Jun 06 01:10:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:34 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-602764a2-285c-4bbb-ba4d-33e8d9d29163 1073741824" returned: 0 in 1.936s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:34 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:INSERT=32,cinder:UPDATE=92,cinder:SELECT=84,cinder:DELETE=6 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:10:34 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:10:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Flow 'volume_create_manager' (f6ccd45c-ca50-4d5c-87fc-d14397cc82c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:10:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2ee775-0639-4b00-9bd4-5a97283ca26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:34 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=95,cinder:UPDATE=93,cinder:INSERT=22,cinder:DELETE=7 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:10:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-602764a2-285c-4bbb-ba4d-33e8d9d29163 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2ee775-0639-4b00-9bd4-5a97283ca26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1871930588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c7513e-0fbd-44d4-af1c-7282c698dd97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bdff5ad0be485bb2d0b14142b79b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:10:34Z,use_quota=True,user_id='33fffa1284824ff081582edf2736ad5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53be0e9f-d144-4113-9d83-097d4cd7c096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:34 devstack sudo[96422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-602764a2-285c-4bbb-ba4d-33e8d9d29163
Jun 06 01:10:34 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53be0e9f-d144-4113-9d83-097d4cd7c096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d201ad4b-2045-433b-b386-b1a79731a2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d201ad4b-2045-433b-b386-b1a79731a2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52c7513e-0fbd-44d4-af1c-7282c698dd97', 'volume_name': 'volume-52c7513e-0fbd-44d4-af1c-7282c698dd97', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4d763a-4dd9-4314-9995-7f992c35d08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4d763a-4dd9-4314-9995-7f992c35d08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b99132-ce0c-4aae-99aa-259ead3cb8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:34 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume 52c7513e-0fbd-44d4-af1c-7282c698dd97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52c7513e-0fbd-44d4-af1c-7282c698dd97', 'volume_size': 1}
Jun 06 01:10:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Flow 'volume_create_manager' (1607c0ad-6954-458c-a280-063fb37bc92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52936e17-7724-47a4-b846-9414336d81a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52936e17-7724-47a4-b846-9414336d81a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1631500476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4a957c-63bf-465f-b336-668a49d4c033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bdff5ad0be485bb2d0b14142b79b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:10:35Z,use_quota=True,user_id='33fffa1284824ff081582edf2736ad5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3106c422-0af5-413e-9c1d-436b416d6e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3106c422-0af5-413e-9c1d-436b416d6e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5269198b-e5fd-42df-8b54-0daf06304fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5269198b-e5fd-42df-8b54-0daf06304fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4a957c-63bf-465f-b336-668a49d4c033', 'volume_name': 'volume-1d4a957c-63bf-465f-b336-668a49d4c033', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f112c24-477c-47da-bd05-244941187758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f112c24-477c-47da-bd05-244941187758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd5abdc-12d2-4af4-bfe7-6692ef646ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:35 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume 1d4a957c-63bf-465f-b336-668a49d4c033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4a957c-63bf-465f-b336-668a49d4c033', 'volume_size': 1}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:35 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-602764a2-285c-4bbb-ba4d-33e8d9d29163" returned: 0 in 1.003s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] <== create_volume: return (3230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.233s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.512s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-282127066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f3ebb5-05bd-439e-be9b-c9c5dcad6677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bdff5ad0be485bb2d0b14142b79b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:10:33Z,use_quota=True,user_id='33fffa1284824ff081582edf2736ad5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Creating volume 93f3ebb5-05bd-439e-be9b-c9c5dcad6677 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:10:35 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-93f3ebb5-05bd-439e-be9b-c9c5dcad6677 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:35 devstack sudo[96426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-93f3ebb5-05bd-439e-be9b-c9c5dcad6677 1073741824
Jun 06 01:10:35 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efedf26-8665-4423-b38a-bdfa77c2881d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602764a2-285c-4bbb-ba4d-33e8d9d29163', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b3b98b-9e99-47d7-9358-65d3de490d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:35 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume volume-602764a2-285c-4bbb-ba4d-33e8d9d29163 (602764a2-285c-4bbb-ba4d-33e8d9d29163): created successfully
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b3b98b-9e99-47d7-9358-65d3de490d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Flow 'volume_create_manager' (8575e2bc-ad38-4a7d-8f63-34416406dc2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:10:35 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-aa2ee7b1-d4b4-46bc-96c4-107aac51d150 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Created volume successfully.
Jun 06 01:10:36 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-93f3ebb5-05bd-439e-be9b-c9c5dcad6677 1073741824" returned: 0 in 0.998s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-93f3ebb5-05bd-439e-be9b-c9c5dcad6677 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:36 devstack sudo[96433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-93f3ebb5-05bd-439e-be9b-c9c5dcad6677
Jun 06 01:10:36 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:37 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-93f3ebb5-05bd-439e-be9b-c9c5dcad6677" returned: 0 in 0.678s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:10:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.515s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-618078303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a363358-5a51-4c18-a55d-e079a4c91de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bdff5ad0be485bb2d0b14142b79b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:10:33Z,use_quota=True,user_id='33fffa1284824ff081582edf2736ad5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:10:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Creating volume 0a363358-5a51-4c18-a55d-e079a4c91de8 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:10:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:10:37 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:10:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0a363358-5a51-4c18-a55d-e079a4c91de8 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:37 devstack sudo[96436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0a363358-5a51-4c18-a55d-e079a4c91de8 1073741824
Jun 06 01:10:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760a3a31-36a0-4182-9026-ffaa0eeb935c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93f3ebb5-05bd-439e-be9b-c9c5dcad6677', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:37 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219c1422-90bf-4262-b11a-c06f8fbf2de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:37 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume volume-93f3ebb5-05bd-439e-be9b-c9c5dcad6677 (93f3ebb5-05bd-439e-be9b-c9c5dcad6677): created successfully
Jun 06 01:10:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219c1422-90bf-4262-b11a-c06f8fbf2de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Flow 'volume_create_manager' (c1abe8d0-ec37-41d2-a601-c27737641da3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:10:37 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-1054b2ad-a7a6-4743-bd75-eb8b7836e3d6 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Created volume successfully.
Jun 06 01:10:38 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0a363358-5a51-4c18-a55d-e079a4c91de8 1073741824" returned: 0 in 0.831s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0a363358-5a51-4c18-a55d-e079a4c91de8 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:38 devstack sudo[96441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0a363358-5a51-4c18-a55d-e079a4c91de8
Jun 06 01:10:38 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:39 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0a363358-5a51-4c18-a55d-e079a4c91de8" returned: 0 in 1.086s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:10:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.598s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1871930588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c7513e-0fbd-44d4-af1c-7282c698dd97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bdff5ad0be485bb2d0b14142b79b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:10:34Z,use_quota=True,user_id='33fffa1284824ff081582edf2736ad5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:10:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Creating volume 52c7513e-0fbd-44d4-af1c-7282c698dd97 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:10:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:10:39 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:10:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-52c7513e-0fbd-44d4-af1c-7282c698dd97 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:39 devstack sudo[96445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-52c7513e-0fbd-44d4-af1c-7282c698dd97 1073741824
Jun 06 01:10:39 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e832919f-de74-4779-9f40-c5f46521a0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a363358-5a51-4c18-a55d-e079a4c91de8', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06994f2-e083-42a7-9bfd-a4279fd0e139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:39 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume volume-0a363358-5a51-4c18-a55d-e079a4c91de8 (0a363358-5a51-4c18-a55d-e079a4c91de8): created successfully
Jun 06 01:10:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06994f2-e083-42a7-9bfd-a4279fd0e139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Flow 'volume_create_manager' (cc2376da-3210-416a-ab6c-f249370e6c55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:10:39 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-94b550f6-c089-4f7f-b221-ffc7e8f1b4bb tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Created volume successfully.
Jun 06 01:10:40 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-52c7513e-0fbd-44d4-af1c-7282c698dd97 1073741824" returned: 0 in 1.436s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-52c7513e-0fbd-44d4-af1c-7282c698dd97 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:40 devstack sudo[96468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-52c7513e-0fbd-44d4-af1c-7282c698dd97
Jun 06 01:10:40 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:41 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-52c7513e-0fbd-44d4-af1c-7282c698dd97" returned: 0 in 0.960s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] <== create_volume: return (2459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:10:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.463s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.491s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1631500476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4a957c-63bf-465f-b336-668a49d4c033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bdff5ad0be485bb2d0b14142b79b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:10:35Z,use_quota=True,user_id='33fffa1284824ff081582edf2736ad5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:10:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Creating volume 1d4a957c-63bf-465f-b336-668a49d4c033 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:10:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:10:41 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:10:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1d4a957c-63bf-465f-b336-668a49d4c033 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b99132-ce0c-4aae-99aa-259ead3cb8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52c7513e-0fbd-44d4-af1c-7282c698dd97', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4605281-20c7-4926-b7af-5423292dfae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:41 devstack sudo[96471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1d4a957c-63bf-465f-b336-668a49d4c033 1073741824
Jun 06 01:10:41 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:41 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume volume-52c7513e-0fbd-44d4-af1c-7282c698dd97 (52c7513e-0fbd-44d4-af1c-7282c698dd97): created successfully
Jun 06 01:10:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4605281-20c7-4926-b7af-5423292dfae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Flow 'volume_create_manager' (f6ccd45c-ca50-4d5c-87fc-d14397cc82c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:10:41 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-fd907ba7-80e9-47e5-ac49-8f6f66d38ca4 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Created volume successfully.
Jun 06 01:10:42 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1d4a957c-63bf-465f-b336-668a49d4c033 1073741824" returned: 0 in 1.097s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1d4a957c-63bf-465f-b336-668a49d4c033 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:42 devstack sudo[96480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1d4a957c-63bf-465f-b336-668a49d4c033
Jun 06 01:10:42 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:43 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1d4a957c-63bf-465f-b336-668a49d4c033" returned: 0 in 0.752s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:10:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd5abdc-12d2-4af4-bfe7-6692ef646ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4a957c-63bf-465f-b336-668a49d4c033', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf649c4-ad32-4e4b-bcda-bda0212872dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:10:43 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Volume volume-1d4a957c-63bf-465f-b336-668a49d4c033 (1d4a957c-63bf-465f-b336-668a49d4c033): created successfully
Jun 06 01:10:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf649c4-ad32-4e4b-bcda-bda0212872dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:10:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Flow 'volume_create_manager' (1607c0ad-6954-458c-a280-063fb37bc92c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:10:43 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-1f7708e3-02f1-4923-b1e8-f823f1c1d920 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Created volume successfully.
Jun 06 01:10:44 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "cinder-1d4a957c-63bf-465f-b336-668a49d4c033-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:44 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-1d4a957c-63bf-465f-b336-668a49d4c033-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:44 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "cinder-quobyte-1d4a957c-63bf-465f-b336-668a49d4c033" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:44 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-quobyte-1d4a957c-63bf-465f-b336-668a49d4c033" acquired by "delete_volume" :: waited 0.035s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:44 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe574387-c166-4762-9ff5-2d89a1499875]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:10:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1d4a957c-63bf-465f-b336-668a49d4c033 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:44 devstack sudo[96484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1d4a957c-63bf-465f-b336-668a49d4c033
Jun 06 01:10:44 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:45 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1d4a957c-63bf-465f-b336-668a49d4c033" returned: 0 in 0.860s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1d4a957c-63bf-465f-b336-668a49d4c033 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:45 devstack sudo[96490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1d4a957c-63bf-465f-b336-668a49d4c033
Jun 06 01:10:45 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:46 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1d4a957c-63bf-465f-b336-668a49d4c033" returned: 0 in 0.641s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-quobyte-1d4a957c-63bf-465f-b336-668a49d4c033" released by "delete_volume" :: held 1.587s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Created reservations ['ec5154da-60d8-43fc-bbff-352b86bd74ee', 'ac125168-ae0d-4806-b320-755743ceaf33', 'a4f5e646-62d0-43ca-9e7e-daa23d925edf', '30d098f0-c325-4a2d-a3e8-8ee1d78a7007'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:46 devstack sudo[96493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:10:46 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "cinder-52c7513e-0fbd-44d4-af1c-7282c698dd97-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-52c7513e-0fbd-44d4-af1c-7282c698dd97-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "cinder-quobyte-52c7513e-0fbd-44d4-af1c-7282c698dd97" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-quobyte-52c7513e-0fbd-44d4-af1c-7282c698dd97" acquired by "delete_volume" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4dc177-520a-4c40-b58d-4b69b187ee1e]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-52c7513e-0fbd-44d4-af1c-7282c698dd97 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:46 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.674s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:10:46 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Deleted volume successfully.
Jun 06 01:10:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-24d8754b-9812-4afd-8d28-a4a7ec7aa982 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-1d4a957c-63bf-465f-b336-668a49d4c033-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:46 devstack sudo[96496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-52c7513e-0fbd-44d4-af1c-7282c698dd97
Jun 06 01:10:46 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:47 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-52c7513e-0fbd-44d4-af1c-7282c698dd97" returned: 0 in 0.759s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-52c7513e-0fbd-44d4-af1c-7282c698dd97 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:47 devstack sudo[96501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-52c7513e-0fbd-44d4-af1c-7282c698dd97
Jun 06 01:10:47 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:48 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-52c7513e-0fbd-44d4-af1c-7282c698dd97" returned: 0 in 0.756s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:48 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-quobyte-52c7513e-0fbd-44d4-af1c-7282c698dd97" released by "delete_volume" :: held 1.576s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:48 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Created reservations ['1a30f47e-3e14-4af0-bb7f-9b59334a8b43', 'f287ca22-438a-4665-8ced-de60b659ed36', '6733fd43-7e63-42c1-aaba-9b927740affd', '44d76a26-77f6-4bdb-8d82-6088da1a93f3'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:10:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:48 devstack sudo[96504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:10:48 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "cinder-0a363358-5a51-4c18-a55d-e079a4c91de8-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-0a363358-5a51-4c18-a55d-e079a4c91de8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "cinder-quobyte-0a363358-5a51-4c18-a55d-e079a4c91de8" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-quobyte-0a363358-5a51-4c18-a55d-e079a4c91de8" acquired by "delete_volume" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:49 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01cf9a9-fc70-45dc-b98d-1ea490c2b5ea]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:10:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0a363358-5a51-4c18-a55d-e079a4c91de8 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:49 devstack sudo[96506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0a363358-5a51-4c18-a55d-e079a4c91de8
Jun 06 01:10:49 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:49 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.861s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:49 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:10:49 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Deleted volume successfully.
Jun 06 01:10:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9677c270-c1d3-4335-a0af-e70ff957d6c9 tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-52c7513e-0fbd-44d4-af1c-7282c698dd97-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:50 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0a363358-5a51-4c18-a55d-e079a4c91de8" returned: 0 in 0.963s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0a363358-5a51-4c18-a55d-e079a4c91de8 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:50 devstack sudo[96518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0a363358-5a51-4c18-a55d-e079a4c91de8
Jun 06 01:10:50 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:50 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0a363358-5a51-4c18-a55d-e079a4c91de8" returned: 0 in 0.721s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:50 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-quobyte-0a363358-5a51-4c18-a55d-e079a4c91de8" released by "delete_volume" :: held 1.735s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:50 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Created reservations ['556906ae-3145-485d-bb42-2bb23e4e6005', '7887850f-c829-43b9-9d48-08416543e9b8', 'e8d79e63-4916-4456-8fd6-e2a1fb90a60a', '5e99769e-5004-4472-b3c5-a1e31852f4d7'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:10:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:51 devstack sudo[96532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:10:51 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "cinder-93f3ebb5-05bd-439e-be9b-c9c5dcad6677-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-93f3ebb5-05bd-439e-be9b-c9c5dcad6677-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "cinder-quobyte-93f3ebb5-05bd-439e-be9b-c9c5dcad6677" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-quobyte-93f3ebb5-05bd-439e-be9b-c9c5dcad6677" acquired by "delete_volume" :: waited 0.028s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:51 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b15486-dd0f-4075-835e-19734b235cb1]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:10:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-93f3ebb5-05bd-439e-be9b-c9c5dcad6677 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:51 devstack sudo[96534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-93f3ebb5-05bd-439e-be9b-c9c5dcad6677
Jun 06 01:10:51 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:51 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.762s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:51 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:10:51 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Deleted volume successfully.
Jun 06 01:10:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9bb22735-eb27-4385-a926-901d55e9eaab tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-0a363358-5a51-4c18-a55d-e079a4c91de8-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:52 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-93f3ebb5-05bd-439e-be9b-c9c5dcad6677" returned: 0 in 0.766s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-93f3ebb5-05bd-439e-be9b-c9c5dcad6677 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:52 devstack sudo[96540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-93f3ebb5-05bd-439e-be9b-c9c5dcad6677
Jun 06 01:10:52 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:52 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-93f3ebb5-05bd-439e-be9b-c9c5dcad6677" returned: 0 in 0.755s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:52 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-quobyte-93f3ebb5-05bd-439e-be9b-c9c5dcad6677" released by "delete_volume" :: held 1.578s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:53 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Created reservations ['4c6694c8-c374-4edc-9eb4-80e8c39db391', '12788eaf-a26c-48e9-bd96-82bad07c1614', '52529c12-0b33-43ea-bb0b-564967ae358d', '8a564881-96af-4f66-a6c7-68b097387de1'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:10:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:53 devstack sudo[96544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:10:53 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "cinder-602764a2-285c-4bbb-ba4d-33e8d9d29163-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-602764a2-285c-4bbb-ba4d-33e8d9d29163-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "cinder-quobyte-602764a2-285c-4bbb-ba4d-33e8d9d29163" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-quobyte-602764a2-285c-4bbb-ba4d-33e8d9d29163" acquired by "delete_volume" :: waited 0.046s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:53 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c06be7-97f2-4c17-a344-40feb217c683]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:10:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-602764a2-285c-4bbb-ba4d-33e8d9d29163 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:54 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:54 devstack sudo[96574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-602764a2-285c-4bbb-ba4d-33e8d9d29163
Jun 06 01:10:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.903s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:54 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:10:54 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:54 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Deleted volume successfully.
Jun 06 01:10:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e6409506-510a-4c60-9804-cd004c5c916c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-93f3ebb5-05bd-439e-be9b-c9c5dcad6677-delete_volume" released by "delete_volume" :: held 2.762s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:54 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-602764a2-285c-4bbb-ba4d-33e8d9d29163" returned: 0 in 0.897s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-602764a2-285c-4bbb-ba4d-33e8d9d29163 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:54 devstack sudo[96582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-602764a2-285c-4bbb-ba4d-33e8d9d29163
Jun 06 01:10:54 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:55 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-602764a2-285c-4bbb-ba4d-33e8d9d29163" returned: 0 in 0.866s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:55 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-quobyte-602764a2-285c-4bbb-ba4d-33e8d9d29163" released by "delete_volume" :: held 1.831s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:55 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Created reservations ['465c7e55-62d8-4180-8d7b-924616787693', '223a8600-9723-408f-b2bd-43f4b58d7957', '5f4b20a5-832b-4bd5-bf19-f696f3945453', '1cb7e985-6487-4174-898f-7ee157e4861c'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:10:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:56 devstack sudo[96654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:10:56 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "cinder-7f970507-74c1-4f97-804f-373c22bd7389-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-7f970507-74c1-4f97-804f-373c22bd7389-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "cinder-quobyte-7f970507-74c1-4f97-804f-373c22bd7389" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:10:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-quobyte-7f970507-74c1-4f97-804f-373c22bd7389" acquired by "delete_volume" :: waited 0.026s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:10:56 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1bcc69-1f1f-4c7d-a76c-a11b10cc6d48]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:10:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f970507-74c1-4f97-804f-373c22bd7389 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:56 devstack sudo[96662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f970507-74c1-4f97-804f-373c22bd7389
Jun 06 01:10:56 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:57 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.169s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:57 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:10:57 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Deleted volume successfully.
Jun 06 01:10:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6da41b68-01bd-4cfc-95a1-9f60d30e369a tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-602764a2-285c-4bbb-ba4d-33e8d9d29163-delete_volume" released by "delete_volume" :: held 3.558s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:57 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f970507-74c1-4f97-804f-373c22bd7389" returned: 0 in 1.160s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f970507-74c1-4f97-804f-373c22bd7389 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:57 devstack sudo[96670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f970507-74c1-4f97-804f-373c22bd7389
Jun 06 01:10:57 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:58 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7f970507-74c1-4f97-804f-373c22bd7389" returned: 0 in 0.765s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-quobyte-7f970507-74c1-4f97-804f-373c22bd7389" released by "delete_volume" :: held 2.009s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:10:58 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Created reservations ['de376d7c-10c5-4cf6-b967-b6650a5bb278', 'd8756ff2-4c5e-4c45-a16b-2c0efbdb4065', 'd4c079d6-fcea-487a-a769-2ead61704a8c', '22942f84-308c-4d07-8f72-dc3f6a05a089'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:10:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:58 devstack sudo[96674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:10:58 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:10:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:10:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:10:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:10:59 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root
Jun 06 01:10:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:10:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:10:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:10:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.734s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:10:59 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:10:59 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Deleted volume successfully.
Jun 06 01:10:59 devstack sudo[96677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:10:59 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:10:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-48b4788e-77ee-4db5-ad4d-d4dd1098ec0c tempest-CreateVolumesFromSourceVolumeTest-1986813939 None] Lock "cinder-7f970507-74c1-4f97-804f-373c22bd7389-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:11:00 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.776s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Flow 'volume_create_manager' (c0b9b4ff-7b71-437b-84d4-21cd2bba8be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0b83f9-921a-4391-941d-0c4a69417a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0b83f9-921a-4391-941d-0c4a69417a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5933660-234c-470f-8f78-4a88a4933cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e91a041b8c4a57a9e74eb4868cb2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:11:02Z,use_quota=True,user_id='55a9d64086634bf091e48767d8730be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11b64c8-d7e6-40fe-8c8f-146aca67c62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11b64c8-d7e6-40fe-8c8f-146aca67c62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f81177-8b77-4e4a-9c26-df3aa1462e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f81177-8b77-4e4a-9c26-df3aa1462e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5933660-234c-470f-8f78-4a88a4933cb0', 'volume_name': 'volume-b5933660-234c-470f-8f78-4a88a4933cb0', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697dc563-a54f-4606-80fe-f8d9f472132b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697dc563-a54f-4606-80fe-f8d9f472132b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38feba0c-8a1e-4eef-b65a-602c95fc1be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:02 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Volume b5933660-234c-470f-8f78-4a88a4933cb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5933660-234c-470f-8f78-4a88a4933cb0', 'volume_size': 1}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5933660-234c-470f-8f78-4a88a4933cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e91a041b8c4a57a9e74eb4868cb2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:11:02Z,use_quota=True,user_id='55a9d64086634bf091e48767d8730be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Creating volume b5933660-234c-470f-8f78-4a88a4933cb0 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:11:02 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:11:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b5933660-234c-470f-8f78-4a88a4933cb0 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:02 devstack sudo[96688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b5933660-234c-470f-8f78-4a88a4933cb0 1073741824
Jun 06 01:11:02 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:03 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b5933660-234c-470f-8f78-4a88a4933cb0 1073741824" returned: 0 in 1.242s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b5933660-234c-470f-8f78-4a88a4933cb0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:03 devstack sudo[96696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b5933660-234c-470f-8f78-4a88a4933cb0
Jun 06 01:11:03 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:04 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b5933660-234c-470f-8f78-4a88a4933cb0" returned: 0 in 0.918s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] <== create_volume: return (2229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:11:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.234s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:11:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38feba0c-8a1e-4eef-b65a-602c95fc1be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5933660-234c-470f-8f78-4a88a4933cb0', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c9a1e3-33fe-4e1d-8356-d5c83d6358ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:04 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Volume volume-b5933660-234c-470f-8f78-4a88a4933cb0 (b5933660-234c-470f-8f78-4a88a4933cb0): created successfully
Jun 06 01:11:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c9a1e3-33fe-4e1d-8356-d5c83d6358ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Flow 'volume_create_manager' (c0b9b4ff-7b71-437b-84d4-21cd2bba8be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:11:04 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-478d2225-148c-4acc-a2d6-e25003ab22e9 tempest-CinderUnicodeTest-1329667533 None] Created volume successfully.
Jun 06 01:11:05 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:11:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Flow 'volume_create_manager' (1f3f24a9-0ea7-4da7-97d8-2ad424565c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:11:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d61e64a-1012-49d8-a966-84802ca30f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d61e64a-1012-49d8-a966-84802ca30f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:11:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-759804714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fce114-0f79-43e7-aec8-98e484893a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e91a041b8c4a57a9e74eb4868cb2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:11:06Z,use_quota=True,user_id='55a9d64086634bf091e48767d8730be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968e0604-703d-4e9b-90b3-dae8da2f9486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968e0604-703d-4e9b-90b3-dae8da2f9486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d97112-a933-4772-9057-d9a51bd9709d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d97112-a933-4772-9057-d9a51bd9709d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2fce114-0f79-43e7-aec8-98e484893a1b', 'volume_name': 'volume-f2fce114-0f79-43e7-aec8-98e484893a1b', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9b6dd6-bac2-4fa4-8739-cadde6da17aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9b6dd6-bac2-4fa4-8739-cadde6da17aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d7eccf-baed-4892-9915-692ecf37b333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:06 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Volume f2fce114-0f79-43e7-aec8-98e484893a1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2fce114-0f79-43e7-aec8-98e484893a1b', 'volume_size': 1}
Jun 06 01:11:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:11:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:11:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:11:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-759804714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fce114-0f79-43e7-aec8-98e484893a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e91a041b8c4a57a9e74eb4868cb2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:11:06Z,use_quota=True,user_id='55a9d64086634bf091e48767d8730be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:11:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Creating volume f2fce114-0f79-43e7-aec8-98e484893a1b {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:11:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:11:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:11:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:11:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:11:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:11:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:11:06 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:11:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:06 devstack sudo[96700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b 1073741824
Jun 06 01:11:06 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:07 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b 1073741824" returned: 0 in 1.119s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:07 devstack sudo[96710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b
Jun 06 01:11:07 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:08 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b" returned: 0 in 1.018s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] <== create_volume: return (2202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:11:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.205s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:11:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d7eccf-baed-4892-9915-692ecf37b333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2fce114-0f79-43e7-aec8-98e484893a1b', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769e7072-129c-47f6-80cf-a2e70346db7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:08 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Volume volume-f2fce114-0f79-43e7-aec8-98e484893a1b (f2fce114-0f79-43e7-aec8-98e484893a1b): created successfully
Jun 06 01:11:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769e7072-129c-47f6-80cf-a2e70346db7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Flow 'volume_create_manager' (1f3f24a9-0ea7-4da7-97d8-2ad424565c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:11:08 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-6c3081de-3a04-409d-bbad-41e7ff978d53 tempest-CinderUnicodeTest-1329667533 None] Created volume successfully.
Jun 06 01:11:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:11:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:11:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] Creating offline snapshot bdaf8141-7864-438d-99b4-e8520893a2d0 of volume f2fce114-0f79-43e7-aec8-98e484893a1b {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:11:10 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0466529-5ee0-4d73-96a3-1aed9c275180]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:11:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:10 devstack sudo[96763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b
Jun 06 01:11:10 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:10 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b" returned: 0 in 0.885s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:10 devstack sudo[96784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0 1G
Jun 06 01:11:10 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:11 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0 1G" returned: 0 in 0.958s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2fce114-0f79-43e7-aec8-98e484893a1b -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:11 devstack sudo[96792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2fce114-0f79-43e7-aec8-98e484893a1b -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0
Jun 06 01:11:11 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:12 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2fce114-0f79-43e7-aec8-98e484893a1b -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0" returned: 0 in 0.728s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:12 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0 is being set with open permissions: ugo+rw
Jun 06 01:11:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:12 devstack sudo[96797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0
Jun 06 01:11:12 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:13 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0" returned: 0 in 0.923s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:13 devstack sudo[96809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.info
Jun 06 01:11:13 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:14 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.info" returned: 0 in 0.854s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:14 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.info is being set with open permissions: ugo+rw
Jun 06 01:11:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:14 devstack sudo[96844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.info
Jun 06 01:11:14 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:15 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.info" returned: 0 in 0.771s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.257s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:11:15 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-da4708cf-e270-458e-af2a-a275304425ea tempest-CinderUnicodeTest-1329667533 None] Create snapshot completed successfully
Jun 06 01:11:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] Acquiring lock "cinder-bdaf8141-7864-438d-99b4-e8520893a2d0-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:11:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] Lock "cinder-bdaf8141-7864-438d-99b4-e8520893a2d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:11:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] Acquiring lock "cinder-quobyte-f2fce114-0f79-43e7-aec8-98e484893a1b" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:11:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] Lock "cinder-quobyte-f2fce114-0f79-43e7-aec8-98e484893a1b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:11:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] Acquiring lock "cinder-quobyte-bdaf8141-7864-438d-99b4-e8520893a2d0" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:11:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] Lock "cinder-quobyte-bdaf8141-7864-438d-99b4-e8520893a2d0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:11:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] Deleting offline snapshot bdaf8141-7864-438d-99b4-e8520893a2d0 of volume f2fce114-0f79-43e7-aec8-98e484893a1b {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:11:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] snapshot_file for this snap is: volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:11:16 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21d471f-07ec-40dd-919a-fca9e8e0ffc7]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:11:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:16 devstack sudo[96924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0
Jun 06 01:11:16 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:17 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0" returned: 0 in 0.923s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2fce114-0f79-43e7-aec8-98e484893a1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:11:17 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[08826d47-9a61-4be4-983f-b3f462b77363]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:11:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:17 devstack sudo[96934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b
Jun 06 01:11:17 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:18 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b" returned: 0 in 0.746s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:18 devstack sudo[96939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0
Jun 06 01:11:18 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:19 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0" returned: 0 in 1.047s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:19 devstack sudo[96980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0
Jun 06 01:11:19 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Flow 'volume_create_manager' (44d7ea21-e82f-41b5-a503-d7a4f6e5f6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2453a790-3580-4a79-b85a-a65e3f00cacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2453a790-3580-4a79-b85a-a65e3f00cacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-535491929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf42c609-f93e-4a23-951e-2f848afdfbd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd6e8b90679488593ec04ba29c2ddbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:11:20Z,use_quota=True,user_id='64931d8bb7564cb78df17c12d9abf9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907f81c8-1d9c-4383-83c5-a9c803ad8e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907f81c8-1d9c-4383-83c5-a9c803ad8e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa7c5ef-8e31-406a-b343-b5cd01156c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa7c5ef-8e31-406a-b343-b5cd01156c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf42c609-f93e-4a23-951e-2f848afdfbd0', 'volume_name': 'volume-cf42c609-f93e-4a23-951e-2f848afdfbd0', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688ace7f-2e7c-47b0-bd48-1d937aa443c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688ace7f-2e7c-47b0-bd48-1d937aa443c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae9c272-b74c-44c1-8ef9-1b97b65cc898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:19 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Volume cf42c609-f93e-4a23-951e-2f848afdfbd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf42c609-f93e-4a23-951e-2f848afdfbd0', 'volume_size': 1}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-535491929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf42c609-f93e-4a23-951e-2f848afdfbd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd6e8b90679488593ec04ba29c2ddbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:11:20Z,use_quota=True,user_id='64931d8bb7564cb78df17c12d9abf9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Creating volume cf42c609-f93e-4a23-951e-2f848afdfbd0 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:11:19 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:11:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cf42c609-f93e-4a23-951e-2f848afdfbd0 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:19 devstack sudo[97003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cf42c609-f93e-4a23-951e-2f848afdfbd0 1073741824
Jun 06 01:11:19 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:20 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b.bdaf8141-7864-438d-99b4-e8520893a2d0" returned: 0 in 1.348s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] Lock "cinder-quobyte-bdaf8141-7864-438d-99b4-e8520893a2d0" released by "_delete_snapshot" :: held 4.283s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:11:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] Lock "cinder-quobyte-f2fce114-0f79-43e7-aec8-98e484893a1b" released by "delete_snapshot" :: held 4.346s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:11:20 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] Created reservations ['956c1cdd-edb9-4293-a37c-a69ccb8f6e05', '7183bea4-9ebc-4555-9848-cf052e5c7f25', '97f1ecc0-167d-4a10-bad4-d2087166f6e5', 'b8f84657-70e7-4897-8183-ce572cd6a120'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:11:20 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] Delete snapshot completed successfully.
Jun 06 01:11:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c15d3686-cda6-48c0-840b-204722bbedae tempest-CinderUnicodeTest-1329667533 None] Lock "cinder-bdaf8141-7864-438d-99b4-e8520893a2d0-delete_snapshot" released by "delete_snapshot" :: held 4.546s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:11:21 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cf42c609-f93e-4a23-951e-2f848afdfbd0 1073741824" returned: 0 in 1.455s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cf42c609-f93e-4a23-951e-2f848afdfbd0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:21 devstack sudo[97025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cf42c609-f93e-4a23-951e-2f848afdfbd0
Jun 06 01:11:21 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] Acquiring lock "cinder-f2fce114-0f79-43e7-aec8-98e484893a1b-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:11:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] Lock "cinder-f2fce114-0f79-43e7-aec8-98e484893a1b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:11:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] Acquiring lock "cinder-quobyte-f2fce114-0f79-43e7-aec8-98e484893a1b" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:11:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] Lock "cinder-quobyte-f2fce114-0f79-43e7-aec8-98e484893a1b" acquired by "delete_volume" :: waited 0.055s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:11:22 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d16e109-79e3-4401-8854-4b48e58af30c]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:11:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:22 devstack sudo[97027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b
Jun 06 01:11:22 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:22 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cf42c609-f93e-4a23-951e-2f848afdfbd0" returned: 0 in 1.355s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] <== create_volume: return (2897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:11:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.900s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:11:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae9c272-b74c-44c1-8ef9-1b97b65cc898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf42c609-f93e-4a23-951e-2f848afdfbd0', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4471f459-590f-441e-9f12-955e1edc73d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:22 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Volume volume-cf42c609-f93e-4a23-951e-2f848afdfbd0 (cf42c609-f93e-4a23-951e-2f848afdfbd0): created successfully
Jun 06 01:11:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4471f459-590f-441e-9f12-955e1edc73d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Flow 'volume_create_manager' (44d7ea21-e82f-41b5-a503-d7a4f6e5f6f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:11:22 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-1a58e66b-9f4e-4195-aff9-9e2425b72220 tempest-TestMinimumBasicScenario-512914887 None] Created volume successfully.
Jun 06 01:11:23 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b" returned: 0 in 1.338s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:23 devstack sudo[97039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b
Jun 06 01:11:23 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:24 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2fce114-0f79-43e7-aec8-98e484893a1b" returned: 0 in 1.075s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] Lock "cinder-quobyte-f2fce114-0f79-43e7-aec8-98e484893a1b" released by "delete_volume" :: held 2.532s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:11:24 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] Created reservations ['9f7100bd-ed0f-4d3f-87ef-eb6ded20dcff', 'fba47e74-01a4-4aa4-967a-479ef06c21ab', '7e1e47d2-922c-4f04-82e6-95d12412557f', '4e459979-6e7d-4f6c-b6ae-f95ed25e85ff'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:11:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:11:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:11:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:11:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:11:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:11:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:24 devstack sudo[97043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:11:25 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] Acquiring lock "cinder-b5933660-234c-470f-8f78-4a88a4933cb0-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:11:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] Lock "cinder-b5933660-234c-470f-8f78-4a88a4933cb0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:11:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] Acquiring lock "cinder-quobyte-b5933660-234c-470f-8f78-4a88a4933cb0" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:11:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] Lock "cinder-quobyte-b5933660-234c-470f-8f78-4a88a4933cb0" acquired by "delete_volume" :: waited 0.027s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:11:25 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[4516186e-1459-4bbe-842f-d9447a16c15e]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:11:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b5933660-234c-470f-8f78-4a88a4933cb0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:25 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.931s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:25 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:11:25 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] Deleted volume successfully.
Jun 06 01:11:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-83bbf67f-d913-4896-9deb-e237786496e0 tempest-CinderUnicodeTest-1329667533 None] Lock "cinder-f2fce114-0f79-43e7-aec8-98e484893a1b-delete_volume" released by "delete_volume" :: held 3.941s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:11:26 devstack sudo[97049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b5933660-234c-470f-8f78-4a88a4933cb0
Jun 06 01:11:26 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-1d4c1aab-0f3d-421b-be03-97ffea1ef4c9 req-d80a1025-d33b-4bd5-9ec5-8f6ec2ae7de4 tempest-TestMinimumBasicScenario-512914887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:11:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-1d4c1aab-0f3d-421b-be03-97ffea1ef4c9 req-d80a1025-d33b-4bd5-9ec5-8f6ec2ae7de4 tempest-TestMinimumBasicScenario-512914887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:11:26 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[476c7280-9829-4ffc-8df6-643bb0339e58]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:11:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-1d4c1aab-0f3d-421b-be03-97ffea1ef4c9 req-d80a1025-d33b-4bd5-9ec5-8f6ec2ae7de4 tempest-TestMinimumBasicScenario-512914887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cf42c609-f93e-4a23-951e-2f848afdfbd0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:27 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b5933660-234c-470f-8f78-4a88a4933cb0" returned: 0 in 1.302s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b5933660-234c-470f-8f78-4a88a4933cb0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:27 devstack sudo[97067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b5933660-234c-470f-8f78-4a88a4933cb0
Jun 06 01:11:27 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:27 devstack sudo[97066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cf42c609-f93e-4a23-951e-2f848afdfbd0
Jun 06 01:11:27 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:28 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-1d4c1aab-0f3d-421b-be03-97ffea1ef4c9 req-d80a1025-d33b-4bd5-9ec5-8f6ec2ae7de4 tempest-TestMinimumBasicScenario-512914887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cf42c609-f93e-4a23-951e-2f848afdfbd0" returned: 0 in 1.342s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-1d4c1aab-0f3d-421b-be03-97ffea1ef4c9 req-d80a1025-d33b-4bd5-9ec5-8f6ec2ae7de4 tempest-TestMinimumBasicScenario-512914887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.387s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:11:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-1d4c1aab-0f3d-421b-be03-97ffea1ef4c9 req-d80a1025-d33b-4bd5-9ec5-8f6ec2ae7de4 tempest-TestMinimumBasicScenario-512914887 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-cf42c609-f93e-4a23-951e-2f848afdfbd0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'babb539e-0851-443d-be38-03161aa1f397', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:11:28 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b5933660-234c-470f-8f78-4a88a4933cb0" returned: 0 in 1.411s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:28 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] Lock "cinder-quobyte-b5933660-234c-470f-8f78-4a88a4933cb0" released by "delete_volume" :: held 2.807s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:11:28 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] Created reservations ['18c5f01e-ae3c-41b8-82b3-40c5e59ff302', '2b205c6b-95d1-4d7f-84a6-ed1dc2602d9e', '3668833a-5fc4-46d8-bf82-831811d040c2', '1e431a39-c63f-4bd4-b089-190705160f16'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:11:28 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-1d4c1aab-0f3d-421b-be03-97ffea1ef4c9 req-d80a1025-d33b-4bd5-9ec5-8f6ec2ae7de4 tempest-TestMinimumBasicScenario-512914887 None] attachment_update completed successfully.
Jun 06 01:11:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:11:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:11:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:11:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:11:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:11:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:28 devstack sudo[97106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:11:28 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:30 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.222s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:30 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:11:30 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] Deleted volume successfully.
Jun 06 01:11:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c3eae26b-62c3-430a-ae87-f4be7793f3ff tempest-CinderUnicodeTest-1329667533 None] Lock "cinder-b5933660-234c-470f-8f78-4a88a4933cb0-delete_volume" released by "delete_volume" :: held 4.507s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:11:36 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=73,cinder:UPDATE=101,cinder:DELETE=5,cinder:INSERT=23 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:11:36 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=61,cinder:UPDATE=87,cinder:INSERT=21,cinder:DELETE=12 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:11:36 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-3f5e3536-3365-4be8-8223-48db7684282d req-bea3b053-b97f-4e16-adf9-bca3d78fa7f1 tempest-AttachVolumeNegativeTest-1679390173 None] Terminate volume connection completed successfully.
Jun 06 01:11:36 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3f5e3536-3365-4be8-8223-48db7684282d req-bea3b053-b97f-4e16-adf9-bca3d78fa7f1 tempest-AttachVolumeNegativeTest-1679390173 None] Deleting attachment 436e8331-3425-4e47-afea-882d287967cd. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Flow 'volume_create_manager' (15f4649a-4033-4be7-adee-c363a8f39101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0a87ad-02ed-4fd8-ab66-0a62d469f1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0a87ad-02ed-4fd8-ab66-0a62d469f1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-495148718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540001cc42e2416b8f5ba9561fb606e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:11:45Z,use_quota=True,user_id='3903acbc55da484cbeb4d634428ee9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bad01c4-8a95-439a-b41d-783ec1502fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bad01c4-8a95-439a-b41d-783ec1502fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb53395-d9f2-45ae-a88e-7b323ad7bd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb53395-d9f2-45ae-a88e-7b323ad7bd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc', 'volume_name': 'volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f6af27-5e58-4cf2-8307-101d5a26a936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f6af27-5e58-4cf2-8307-101d5a26a936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f009f0e9-a5fd-4253-bb20-ef55ba6dcddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:45 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Volume ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc', 'volume_size': 1}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-495148718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540001cc42e2416b8f5ba9561fb606e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:11:45Z,use_quota=True,user_id='3903acbc55da484cbeb4d634428ee9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Creating volume ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:11:45 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:11:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:45 devstack sudo[97242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc 1073741824
Jun 06 01:11:45 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:46 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc 1073741824" returned: 0 in 0.772s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:46 devstack sudo[97248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc
Jun 06 01:11:46 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:46 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc" returned: 0 in 0.616s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:11:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:11:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f009f0e9-a5fd-4253-bb20-ef55ba6dcddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2973936-abfe-457a-9666-31b7894210ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:46 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Volume volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc (ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc): created successfully
Jun 06 01:11:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2973936-abfe-457a-9666-31b7894210ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Flow 'volume_create_manager' (15f4649a-4033-4be7-adee-c363a8f39101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:11:46 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-ef2e21da-c152-4d57-aff9-ffd8426e0e40 tempest-AttachVolumeTestJSON-25463068 None] Created volume successfully.
Jun 06 01:11:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-cc0465fb-f47a-4f4f-b7dc-5e319b41be81 req-06f2677d-9387-4ffe-b967-634e5274ce0c tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:11:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-cc0465fb-f47a-4f4f-b7dc-5e319b41be81 req-06f2677d-9387-4ffe-b967-634e5274ce0c tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:11:50 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1acd50-5b40-4aa7-ae3f-138ef2da3953]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:11:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-cc0465fb-f47a-4f4f-b7dc-5e319b41be81 req-06f2677d-9387-4ffe-b967-634e5274ce0c tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:51 devstack sudo[97366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc
Jun 06 01:11:51 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:51 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-cc0465fb-f47a-4f4f-b7dc-5e319b41be81 req-06f2677d-9387-4ffe-b967-634e5274ce0c tempest-AttachVolumeTestJSON-25463068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc" returned: 0 in 0.855s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-cc0465fb-f47a-4f4f-b7dc-5e319b41be81 req-06f2677d-9387-4ffe-b967-634e5274ce0c tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.893s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:11:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-cc0465fb-f47a-4f4f-b7dc-5e319b41be81 req-06f2677d-9387-4ffe-b967-634e5274ce0c tempest-AttachVolumeTestJSON-25463068 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab4018ea-3865-45c1-8c16-91119fff2bc2', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:11:51 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-cc0465fb-f47a-4f4f-b7dc-5e319b41be81 req-06f2677d-9387-4ffe-b967-634e5274ce0c tempest-AttachVolumeTestJSON-25463068 None] attachment_update completed successfully.
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Flow 'volume_create_manager' (7ccb7fd5-526b-47ee-b80b-215ac8dd7547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493462b9-9f42-4b51-80cd-7477e0a1a18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493462b9-9f42-4b51-80cd-7477e0a1a18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-665063068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34de6a85-a880-450e-9e0c-697e8a0db869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540001cc42e2416b8f5ba9561fb606e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:11:57Z,use_quota=True,user_id='3903acbc55da484cbeb4d634428ee9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75055a2a-ab53-4cfb-9586-acdd9f679a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75055a2a-ab53-4cfb-9586-acdd9f679a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915edf81-9382-415a-bd46-740f1ae92088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915edf81-9382-415a-bd46-740f1ae92088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34de6a85-a880-450e-9e0c-697e8a0db869', 'volume_name': 'volume-34de6a85-a880-450e-9e0c-697e8a0db869', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37b3788-f1fe-45f8-8619-c71501a35792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37b3788-f1fe-45f8-8619-c71501a35792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889c84a3-fa61-420f-b5a2-a8e719191d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:57 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Volume 34de6a85-a880-450e-9e0c-697e8a0db869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34de6a85-a880-450e-9e0c-697e8a0db869', 'volume_size': 1}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-665063068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34de6a85-a880-450e-9e0c-697e8a0db869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540001cc42e2416b8f5ba9561fb606e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:11:57Z,use_quota=True,user_id='3903acbc55da484cbeb4d634428ee9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Creating volume 34de6a85-a880-450e-9e0c-697e8a0db869 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:11:57 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:11:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34de6a85-a880-450e-9e0c-697e8a0db869 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:57 devstack sudo[97378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34de6a85-a880-450e-9e0c-697e8a0db869 1073741824
Jun 06 01:11:57 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:58 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34de6a85-a880-450e-9e0c-697e8a0db869 1073741824" returned: 0 in 1.050s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34de6a85-a880-450e-9e0c-697e8a0db869 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:58 devstack sudo[97384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34de6a85-a880-450e-9e0c-697e8a0db869
Jun 06 01:11:58 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:59 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root
Jun 06 01:11:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34de6a85-a880-450e-9e0c-697e8a0db869" returned: 0 in 0.657s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:11:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:11:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:11:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889c84a3-fa61-420f-b5a2-a8e719191d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34de6a85-a880-450e-9e0c-697e8a0db869', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50ec073-984b-466a-9085-453df0ad1b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:11:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:11:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:11:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:11:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:11:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:11:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:11:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:11:59 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Volume volume-34de6a85-a880-450e-9e0c-697e8a0db869 (34de6a85-a880-450e-9e0c-697e8a0db869): created successfully
Jun 06 01:11:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50ec073-984b-466a-9085-453df0ad1b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:11:59 devstack sudo[97389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:11:59 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:11:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Flow 'volume_create_manager' (7ccb7fd5-526b-47ee-b80b-215ac8dd7547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:11:59 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-7a20fe11-6028-457a-8eab-a281266743d3 tempest-AttachVolumeTestJSON-25463068 None] Created volume successfully.
Jun 06 01:12:00 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.845s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:12:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-9095c92c-b75a-4a41-b166-29eb90459348 req-dc6c4847-2b2e-4985-82e1-596b4715906a tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-9095c92c-b75a-4a41-b166-29eb90459348 req-dc6c4847-2b2e-4985-82e1-596b4715906a tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:02 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[8294dbe7-1ecf-425f-ba69-9437276ad636]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:12:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-9095c92c-b75a-4a41-b166-29eb90459348 req-dc6c4847-2b2e-4985-82e1-596b4715906a tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34de6a85-a880-450e-9e0c-697e8a0db869 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:02 devstack sudo[97430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34de6a85-a880-450e-9e0c-697e8a0db869
Jun 06 01:12:02 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:03 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-9095c92c-b75a-4a41-b166-29eb90459348 req-dc6c4847-2b2e-4985-82e1-596b4715906a tempest-AttachVolumeTestJSON-25463068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34de6a85-a880-450e-9e0c-697e8a0db869" returned: 0 in 0.750s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-9095c92c-b75a-4a41-b166-29eb90459348 req-dc6c4847-2b2e-4985-82e1-596b4715906a tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.769s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-9095c92c-b75a-4a41-b166-29eb90459348 req-dc6c4847-2b2e-4985-82e1-596b4715906a tempest-AttachVolumeTestJSON-25463068 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-34de6a85-a880-450e-9e0c-697e8a0db869', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a5581cd-7af2-413a-aa87-747cc01d80ad', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:12:03 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-9095c92c-b75a-4a41-b166-29eb90459348 req-dc6c4847-2b2e-4985-82e1-596b4715906a tempest-AttachVolumeTestJSON-25463068 None] attachment_update completed successfully.
Jun 06 01:12:09 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-092f7ec3-fc98-4756-b172-bbdcc97349c5 req-abf67463-b388-4cd4-915b-929457673985 tempest-AttachVolumeTestJSON-25463068 None] Terminate volume connection completed successfully.
Jun 06 01:12:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-092f7ec3-fc98-4756-b172-bbdcc97349c5 req-abf67463-b388-4cd4-915b-929457673985 tempest-AttachVolumeTestJSON-25463068 None] Deleting attachment ab4018ea-3865-45c1-8c16-91119fff2bc2. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:12:12 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-58c07a44-ece5-4a21-b7df-d4f7d41a6a24 req-8d4b1094-d0b4-4b59-ba6c-cb7755af9284 tempest-AttachVolumeTestJSON-25463068 None] Terminate volume connection completed successfully.
Jun 06 01:12:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-58c07a44-ece5-4a21-b7df-d4f7d41a6a24 req-8d4b1094-d0b4-4b59-ba6c-cb7755af9284 tempest-AttachVolumeTestJSON-25463068 None] Deleting attachment 4a5581cd-7af2-413a-aa87-747cc01d80ad. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:12:14 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-4f9e5b25-f608-452c-845c-83e8d3dea0a7 req-416b11ca-4b3a-4730-a9b7-9a6bd768c7f2 tempest-TestMinimumBasicScenario-512914887 None] Terminate volume connection completed successfully.
Jun 06 01:12:14 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-4f9e5b25-f608-452c-845c-83e8d3dea0a7 req-416b11ca-4b3a-4730-a9b7-9a6bd768c7f2 tempest-TestMinimumBasicScenario-512914887 None] Deleting attachment babb539e-0851-443d-be38-03161aa1f397. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:12:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] Acquiring lock "cinder-cf42c609-f93e-4a23-951e-2f848afdfbd0-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] Lock "cinder-cf42c609-f93e-4a23-951e-2f848afdfbd0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] Acquiring lock "cinder-quobyte-cf42c609-f93e-4a23-951e-2f848afdfbd0" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] Lock "cinder-quobyte-cf42c609-f93e-4a23-951e-2f848afdfbd0" acquired by "delete_volume" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:16 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fbb2a8-0625-45e0-8fa1-67419ac9ee31]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:12:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cf42c609-f93e-4a23-951e-2f848afdfbd0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:16 devstack sudo[97599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cf42c609-f93e-4a23-951e-2f848afdfbd0
Jun 06 01:12:16 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:17 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cf42c609-f93e-4a23-951e-2f848afdfbd0" returned: 0 in 0.854s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cf42c609-f93e-4a23-951e-2f848afdfbd0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:17 devstack sudo[97625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cf42c609-f93e-4a23-951e-2f848afdfbd0
Jun 06 01:12:17 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:18 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cf42c609-f93e-4a23-951e-2f848afdfbd0" returned: 0 in 0.634s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:18 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] Lock "cinder-quobyte-cf42c609-f93e-4a23-951e-2f848afdfbd0" released by "delete_volume" :: held 1.535s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:12:18 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] Created reservations ['9024d4a2-453d-4a06-9f2e-0e1fbc774344', 'a3856c13-04f6-4466-9ba9-a2d56c698878', '74fea2dc-800f-4ad6-812f-eb2deb991e80', 'ff6e95f6-5ddd-415b-bb9c-234ad7e66da4'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:12:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:18 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:18 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:18 devstack sudo[97629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:12:18 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:19 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.611s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:19 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:12:19 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] Deleted volume successfully.
Jun 06 01:12:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9ec3a7cf-4821-42cf-b427-ffecf4ba13c3 tempest-TestMinimumBasicScenario-512914887 None] Lock "cinder-cf42c609-f93e-4a23-951e-2f848afdfbd0-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:12:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "cinder-34de6a85-a880-450e-9e0c-697e8a0db869-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] Lock "cinder-34de6a85-a880-450e-9e0c-697e8a0db869-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "cinder-quobyte-34de6a85-a880-450e-9e0c-697e8a0db869" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] Lock "cinder-quobyte-34de6a85-a880-450e-9e0c-697e8a0db869" acquired by "delete_volume" :: waited 0.013s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:23 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6e0db7-4d82-441f-a9ec-69c5ab6286bc]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:12:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34de6a85-a880-450e-9e0c-697e8a0db869 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:23 devstack sudo[97671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34de6a85-a880-450e-9e0c-697e8a0db869
Jun 06 01:12:23 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:23 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34de6a85-a880-450e-9e0c-697e8a0db869" returned: 0 in 0.711s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34de6a85-a880-450e-9e0c-697e8a0db869 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:23 devstack sudo[97677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34de6a85-a880-450e-9e0c-697e8a0db869
Jun 06 01:12:23 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:24 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34de6a85-a880-450e-9e0c-697e8a0db869" returned: 0 in 0.610s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] Lock "cinder-quobyte-34de6a85-a880-450e-9e0c-697e8a0db869" released by "delete_volume" :: held 1.361s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:12:24 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] Created reservations ['d1cce4b4-a5e3-4371-81d0-02cbddd9065a', '2eebad9b-320b-40de-a4e3-c48678b6debd', 'e917b07d-911e-42b9-9d51-33092d51f5d6', '9ed743db-41d2-411a-b8f0-1887827126ab'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:12:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:24 devstack sudo[97680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:12:24 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:25 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.640s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:25 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:12:25 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] Deleted volume successfully.
Jun 06 01:12:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e9ad736e-cea9-4d89-a5c8-d3aecfda55b1 tempest-AttachVolumeTestJSON-25463068 None] Lock "cinder-34de6a85-a880-450e-9e0c-697e8a0db869-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:12:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "cinder-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] Lock "cinder-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "cinder-quobyte-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] Lock "cinder-quobyte-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc" acquired by "delete_volume" :: waited 0.028s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:25 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[6776a8a6-8035-40c7-87b2-c9111816d789]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:12:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:25 devstack sudo[97683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc
Jun 06 01:12:25 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:26 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc" returned: 0 in 0.717s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:26 devstack sudo[97690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc
Jun 06 01:12:26 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:26 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc" returned: 0 in 0.616s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] Lock "cinder-quobyte-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc" released by "delete_volume" :: held 1.377s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:12:26 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] Created reservations ['179558e7-225d-4706-8be5-0ebc9015992c', 'd84f19ee-d638-482b-8ff5-ea2129e958c2', 'd748760b-f16d-451d-bf53-3146ff82147f', 'a3c7e054-b2cc-4ee0-ba99-cf6cc52b3a28'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:12:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:26 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:26 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:26 devstack sudo[97693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:12:26 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:27 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.610s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:27 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:12:27 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] Deleted volume successfully.
Jun 06 01:12:27 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cdb29c43-fd1c-483d-a419-9f17d4a550ec tempest-AttachVolumeTestJSON-25463068 None] Lock "cinder-ad5fe2fb-0f23-4865-bcc0-5f087ca0d3cc-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:12:27 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "cinder-85545b47-20c8-4f75-b20c-a4aeeb171a2b-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:27 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] Lock "cinder-85545b47-20c8-4f75-b20c-a4aeeb171a2b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:27 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "cinder-quobyte-85545b47-20c8-4f75-b20c-a4aeeb171a2b" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:27 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] Lock "cinder-quobyte-85545b47-20c8-4f75-b20c-a4aeeb171a2b" acquired by "delete_volume" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:27 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb099e1-afbd-4e1d-adb1-9bcb0324dcf8]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:12:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:27 devstack sudo[97696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b
Jun 06 01:12:27 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:28 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b" returned: 0 in 0.734s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:28 devstack sudo[97704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b
Jun 06 01:12:28 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Flow 'volume_create_manager' (bb32d499-61fe-4f51-98e1-42038a8c89e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d7ee5f-16ea-4576-82ea-38b359140164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d7ee5f-16ea-4576-82ea-38b359140164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1844623864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ca450d-78d5-46fc-8589-02ab69314fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54037968ce94bf9a9d1162ad5e945c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:29Z,use_quota=True,user_id='616a9e99d38846d580ff738ea76311ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d56fff-8381-4d8f-9b74-35a850045b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d56fff-8381-4d8f-9b74-35a850045b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf768c6-9ce4-44bb-a3bd-d83b86e6d315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf768c6-9ce4-44bb-a3bd-d83b86e6d315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9ca450d-78d5-46fc-8589-02ab69314fee', 'volume_name': 'volume-e9ca450d-78d5-46fc-8589-02ab69314fee', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236f426d-ef44-4bb7-b379-992e597bbab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236f426d-ef44-4bb7-b379-992e597bbab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7081711-2f6d-4866-849f-655996278dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:28 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Volume e9ca450d-78d5-46fc-8589-02ab69314fee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9ca450d-78d5-46fc-8589-02ab69314fee', 'volume_size': 1}
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1844623864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ca450d-78d5-46fc-8589-02ab69314fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54037968ce94bf9a9d1162ad5e945c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:29Z,use_quota=True,user_id='616a9e99d38846d580ff738ea76311ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Creating volume e9ca450d-78d5-46fc-8589-02ab69314fee {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:12:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:12:29 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:12:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e9ca450d-78d5-46fc-8589-02ab69314fee 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:29 devstack sudo[97706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e9ca450d-78d5-46fc-8589-02ab69314fee 1073741824
Jun 06 01:12:29 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:29 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-85545b47-20c8-4f75-b20c-a4aeeb171a2b" returned: 0 in 0.661s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] Lock "cinder-quobyte-85545b47-20c8-4f75-b20c-a4aeeb171a2b" released by "delete_volume" :: held 1.445s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:12:29 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] Created reservations ['63bbe35b-6149-48c5-a57b-6e29eb170d19', '89fbf2bf-d01d-475a-9490-c2f5d2ea8621', 'd49f223c-d448-42be-99c1-a06e536c3647', '8ad37997-09a9-4c8f-864e-bae3f9fc29a4'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:12:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:29 devstack sudo[97709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:12:29 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:29 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.690s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:29 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:12:29 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] Deleted volume successfully.
Jun 06 01:12:30 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e9ca450d-78d5-46fc-8589-02ab69314fee 1073741824" returned: 0 in 1.011s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3826d7eb-9623-487b-9b8b-92199d72ae36 tempest-AttachVolumeTestJSON-25463068 None] Lock "cinder-85545b47-20c8-4f75-b20c-a4aeeb171a2b-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:12:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e9ca450d-78d5-46fc-8589-02ab69314fee {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:30 devstack sudo[97716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e9ca450d-78d5-46fc-8589-02ab69314fee
Jun 06 01:12:30 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:30 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e9ca450d-78d5-46fc-8589-02ab69314fee" returned: 0 in 0.633s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:12:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7081711-2f6d-4866-849f-655996278dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9ca450d-78d5-46fc-8589-02ab69314fee', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276c4184-90e6-4f3a-bb3c-e75eed7c1cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:30 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Volume volume-e9ca450d-78d5-46fc-8589-02ab69314fee (e9ca450d-78d5-46fc-8589-02ab69314fee): created successfully
Jun 06 01:12:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276c4184-90e6-4f3a-bb3c-e75eed7c1cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Flow 'volume_create_manager' (bb32d499-61fe-4f51-98e1-42038a8c89e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:30 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-682d78f1-8741-4db2-b58e-026b32d503d7 tempest-AttachVolumeNegativeTest-1679390173 None] Created volume successfully.
Jun 06 01:12:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-dfbfc3d0-723c-42b9-9112-2538938b44cf req-c2af0bb4-5422-48cb-9630-afde72de9d6b tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-dfbfc3d0-723c-42b9-9112-2538938b44cf req-c2af0bb4-5422-48cb-9630-afde72de9d6b tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:34 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dad75a9-f472-407a-87aa-9fa4e5a6c095]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:12:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-dfbfc3d0-723c-42b9-9112-2538938b44cf req-c2af0bb4-5422-48cb-9630-afde72de9d6b tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e9ca450d-78d5-46fc-8589-02ab69314fee {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:34 devstack sudo[97736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e9ca450d-78d5-46fc-8589-02ab69314fee
Jun 06 01:12:34 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:35 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-dfbfc3d0-723c-42b9-9112-2538938b44cf req-c2af0bb4-5422-48cb-9630-afde72de9d6b tempest-AttachVolumeNegativeTest-1679390173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e9ca450d-78d5-46fc-8589-02ab69314fee" returned: 0 in 0.810s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-dfbfc3d0-723c-42b9-9112-2538938b44cf req-c2af0bb4-5422-48cb-9630-afde72de9d6b tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.836s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-dfbfc3d0-723c-42b9-9112-2538938b44cf req-c2af0bb4-5422-48cb-9630-afde72de9d6b tempest-AttachVolumeNegativeTest-1679390173 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-e9ca450d-78d5-46fc-8589-02ab69314fee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18512650-644e-4309-b606-81e3c6189970', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:12:35 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-dfbfc3d0-723c-42b9-9112-2538938b44cf req-c2af0bb4-5422-48cb-9630-afde72de9d6b tempest-AttachVolumeNegativeTest-1679390173 None] attachment_update completed successfully.
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=42,cinder:UPDATE=49,cinder:DELETE=4,cinder:INSERT=10 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=43,cinder:SELECT=50,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Flow 'volume_create_manager' (9fb667d8-6fbd-4128-8e8d-9f21ed07761b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790a8a43-896b-4b7d-83e4-629f29b3fb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790a8a43-896b-4b7d-83e4-629f29b3fb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1541146993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f2f10bf-d168-43a3-b947-5eaeb3960b36,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e6666b80f64b481ea9bcc96cb7e85bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:37Z,use_quota=True,user_id='c8f160a2903a4f0fb2b0655daad471c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99514a4-5306-4714-b4f4-9be06ad729d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99514a4-5306-4714-b4f4-9be06ad729d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7552108d-0414-4063-a802-d1d073f73319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7552108d-0414-4063-a802-d1d073f73319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f2f10bf-d168-43a3-b947-5eaeb3960b36', 'volume_name': 'volume-5f2f10bf-d168-43a3-b947-5eaeb3960b36', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512d5444-b5db-4f28-8ea9-8b24583133f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512d5444-b5db-4f28-8ea9-8b24583133f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e14240-67a5-4050-b505-2462c32652ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:37 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Volume 5f2f10bf-d168-43a3-b947-5eaeb3960b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f2f10bf-d168-43a3-b947-5eaeb3960b36', 'volume_size': 1}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1541146993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f2f10bf-d168-43a3-b947-5eaeb3960b36,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e6666b80f64b481ea9bcc96cb7e85bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:37Z,use_quota=True,user_id='c8f160a2903a4f0fb2b0655daad471c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Creating volume 5f2f10bf-d168-43a3-b947-5eaeb3960b36 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:12:37 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5f2f10bf-d168-43a3-b947-5eaeb3960b36 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:37 devstack sudo[98123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5f2f10bf-d168-43a3-b947-5eaeb3960b36 1073741824
Jun 06 01:12:37 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Flow 'volume_create_manager' (408c7f61-d396-4ced-8d7a-77a447670e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45869982-42d3-43f7-9199-4e72aef1a748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45869982-42d3-43f7-9199-4e72aef1a748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-977191224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61e66d8-8f5a-421c-a568-3434d4c25c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86a7f397ebfd4b24bafaff427fd740c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:38Z,use_quota=True,user_id='1c5a4e963b5049368410dc843f24856a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1718bfa1-26ce-4089-884a-d1038361324d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1718bfa1-26ce-4089-884a-d1038361324d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8732e047-f09b-4bd2-96b1-32e9db89e73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8732e047-f09b-4bd2-96b1-32e9db89e73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f61e66d8-8f5a-421c-a568-3434d4c25c3f', 'volume_name': 'volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad82669c-a909-4735-a4a2-ab1502333917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad82669c-a909-4735-a4a2-ab1502333917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71d3a0d-b756-4e2a-8b1d-af885c0c1e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:37 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume f61e66d8-8f5a-421c-a568-3434d4c25c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f', 'volume_size': 1}
Jun 06 01:12:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:38 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5f2f10bf-d168-43a3-b947-5eaeb3960b36 1073741824" returned: 0 in 0.775s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5f2f10bf-d168-43a3-b947-5eaeb3960b36 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:38 devstack sudo[98129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5f2f10bf-d168-43a3-b947-5eaeb3960b36
Jun 06 01:12:38 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:38 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5f2f10bf-d168-43a3-b947-5eaeb3960b36" returned: 0 in 0.598s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:12:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.242s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-977191224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61e66d8-8f5a-421c-a568-3434d4c25c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86a7f397ebfd4b24bafaff427fd740c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:38Z,use_quota=True,user_id='1c5a4e963b5049368410dc843f24856a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:12:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Creating volume f61e66d8-8f5a-421c-a568-3434d4c25c3f {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:12:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:12:38 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:12:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:38 devstack sudo[98132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f 1073741824
Jun 06 01:12:38 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e14240-67a5-4050-b505-2462c32652ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f2f10bf-d168-43a3-b947-5eaeb3960b36', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba7d88e1-8599-459f-a47f-ae17e4a63631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:39 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Volume volume-5f2f10bf-d168-43a3-b947-5eaeb3960b36 (5f2f10bf-d168-43a3-b947-5eaeb3960b36): created successfully
Jun 06 01:12:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba7d88e1-8599-459f-a47f-ae17e4a63631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Flow 'volume_create_manager' (9fb667d8-6fbd-4128-8e8d-9f21ed07761b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:39 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-83a08c70-9bb9-4819-8100-d2912fae79f3 tempest-VolumesTestJSON-1933600037 None] Created volume successfully.
Jun 06 01:12:39 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f 1073741824" returned: 0 in 0.838s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:39 devstack sudo[98138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f
Jun 06 01:12:39 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Flow 'volume_create_manager' (d9f74e25-4bd2-4d2c-9248-2c95b0355c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ffc420d-3088-416b-8a84-87856a82ea27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ffc420d-3088-416b-8a84-87856a82ea27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1901193679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed83f09-b448-460f-8f31-f8f5c3669f3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e6666b80f64b481ea9bcc96cb7e85bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:40Z,use_quota=True,user_id='c8f160a2903a4f0fb2b0655daad471c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a891dc6a-d4fa-4a89-9f65-ea28fd8eb78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a891dc6a-d4fa-4a89-9f65-ea28fd8eb78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1422ddb4-e850-4474-a8fc-3f4f7af0fad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1422ddb4-e850-4474-a8fc-3f4f7af0fad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ed83f09-b448-460f-8f31-f8f5c3669f3e', 'volume_name': 'volume-8ed83f09-b448-460f-8f31-f8f5c3669f3e', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01ec669-1c9f-4127-b7ad-9c637d9d2133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01ec669-1c9f-4127-b7ad-9c637d9d2133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15966b34-853e-43ef-8352-aa00c429c34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:40 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Volume 8ed83f09-b448-460f-8f31-f8f5c3669f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ed83f09-b448-460f-8f31-f8f5c3669f3e', 'volume_size': 1}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:40 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f" returned: 0 in 0.619s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.271s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1901193679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed83f09-b448-460f-8f31-f8f5c3669f3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e6666b80f64b481ea9bcc96cb7e85bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:40Z,use_quota=True,user_id='c8f160a2903a4f0fb2b0655daad471c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Creating volume 8ed83f09-b448-460f-8f31-f8f5c3669f3e {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:12:40 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ed83f09-b448-460f-8f31-f8f5c3669f3e 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71d3a0d-b756-4e2a-8b1d-af885c0c1e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16bdc1d-727d-4cbd-b992-e2c540f8d8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:40 devstack sudo[98141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ed83f09-b448-460f-8f31-f8f5c3669f3e 1073741824
Jun 06 01:12:40 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:40 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f (f61e66d8-8f5a-421c-a568-3434d4c25c3f): created successfully
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16bdc1d-727d-4cbd-b992-e2c540f8d8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Flow 'volume_create_manager' (408c7f61-d396-4ced-8d7a-77a447670e8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:40 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b434c99b-4bac-4962-947a-edaf2d8250eb tempest-CreateVolumesFromSnapshotTest-87833567 None] Created volume successfully.
Jun 06 01:12:40 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-cf9d9d6f-aff7-4b74-8343-56d0d506126a req-35cf94df-0799-4be0-9c58-01a0be6a1e23 tempest-AttachVolumeNegativeTest-1679390173 None] Terminate volume connection completed successfully.
Jun 06 01:12:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-cf9d9d6f-aff7-4b74-8343-56d0d506126a req-35cf94df-0799-4be0-9c58-01a0be6a1e23 tempest-AttachVolumeNegativeTest-1679390173 None] Deleting attachment 18512650-644e-4309-b606-81e3c6189970. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:12:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:41 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ed83f09-b448-460f-8f31-f8f5c3669f3e 1073741824" returned: 0 in 0.855s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ed83f09-b448-460f-8f31-f8f5c3669f3e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:41 devstack sudo[98175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ed83f09-b448-460f-8f31-f8f5c3669f3e
Jun 06 01:12:41 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:41 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ed83f09-b448-460f-8f31-f8f5c3669f3e" returned: 0 in 0.611s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:12:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.859s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15966b34-853e-43ef-8352-aa00c429c34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ed83f09-b448-460f-8f31-f8f5c3669f3e', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a50a4d-4e5e-4398-8d96-f4595e9d15bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] Creating offline snapshot ce728007-6172-4531-bf34-709cc8d7db85 of volume f61e66d8-8f5a-421c-a568-3434d4c25c3f {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:12:42 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Volume volume-8ed83f09-b448-460f-8f31-f8f5c3669f3e (8ed83f09-b448-460f-8f31-f8f5c3669f3e): created successfully
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a50a4d-4e5e-4398-8d96-f4595e9d15bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Flow 'volume_create_manager' (d9f74e25-4bd2-4d2c-9248-2c95b0355c12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9a87fd-14b7-465d-b064-8f798cd9e988]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:42 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-685e48a7-68f6-4a74-98e2-c5e381444e96 tempest-VolumesTestJSON-1933600037 None] Created volume successfully.
Jun 06 01:12:42 devstack sudo[98186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f
Jun 06 01:12:42 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Flow 'volume_create_manager' (f7e7cf4a-ec44-4454-976b-2e70e268f1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca8c863-cd79-479d-bb00-8ecf340a9227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca8c863-cd79-479d-bb00-8ecf340a9227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1299220650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b63594e-b78a-422b-8bcf-17fce06f8b7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e6666b80f64b481ea9bcc96cb7e85bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:43Z,use_quota=True,user_id='c8f160a2903a4f0fb2b0655daad471c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e47e35-9307-4b55-b137-f27e9b838531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e47e35-9307-4b55-b137-f27e9b838531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0874a0cb-5653-4574-9577-cb5d85b37984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0874a0cb-5653-4574-9577-cb5d85b37984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b63594e-b78a-422b-8bcf-17fce06f8b7e', 'volume_name': 'volume-1b63594e-b78a-422b-8bcf-17fce06f8b7e', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a25b55-fdbc-4821-b3a2-6baf93c1959c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a25b55-fdbc-4821-b3a2-6baf93c1959c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4cb3a2-d057-4165-a9f1-14d707b0f1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:42 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Volume 1b63594e-b78a-422b-8bcf-17fce06f8b7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b63594e-b78a-422b-8bcf-17fce06f8b7e', 'volume_size': 1}
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:42 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f" returned: 0 in 0.750s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:42 devstack sudo[98191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85 1G
Jun 06 01:12:42 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:43 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85 1G" returned: 0 in 0.777s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:43 devstack sudo[98197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85
Jun 06 01:12:43 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:44 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85" returned: 0 in 0.715s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:44 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85 is being set with open permissions: ugo+rw
Jun 06 01:12:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:44 devstack sudo[98224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85
Jun 06 01:12:44 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:44 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85" returned: 0 in 0.663s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:44 devstack sudo[98245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.info
Jun 06 01:12:44 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:45 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.info" returned: 0 in 0.598s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:45 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.info is being set with open permissions: ugo+rw
Jun 06 01:12:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:45 devstack sudo[98249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.info
Jun 06 01:12:45 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:46 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.info" returned: 0 in 0.670s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.290s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.506s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1299220650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b63594e-b78a-422b-8bcf-17fce06f8b7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e6666b80f64b481ea9bcc96cb7e85bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:43Z,use_quota=True,user_id='c8f160a2903a4f0fb2b0655daad471c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:12:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Creating volume 1b63594e-b78a-422b-8bcf-17fce06f8b7e {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:12:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:12:46 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:12:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1b63594e-b78a-422b-8bcf-17fce06f8b7e 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:46 devstack sudo[98254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1b63594e-b78a-422b-8bcf-17fce06f8b7e 1073741824
Jun 06 01:12:46 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:46 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-ab4f498a-991e-4af1-96a0-a820b6a25507 tempest-CreateVolumesFromSnapshotTest-87833567 None] Create snapshot completed successfully
Jun 06 01:12:47 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1b63594e-b78a-422b-8bcf-17fce06f8b7e 1073741824" returned: 0 in 0.776s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1b63594e-b78a-422b-8bcf-17fce06f8b7e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:47 devstack sudo[98260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1b63594e-b78a-422b-8bcf-17fce06f8b7e
Jun 06 01:12:47 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:47 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1b63594e-b78a-422b-8bcf-17fce06f8b7e" returned: 0 in 0.602s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4cb3a2-d057-4165-a9f1-14d707b0f1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b63594e-b78a-422b-8bcf-17fce06f8b7e', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4f8374-91de-44f0-b311-65fa48c19f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:47 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Volume volume-1b63594e-b78a-422b-8bcf-17fce06f8b7e (1b63594e-b78a-422b-8bcf-17fce06f8b7e): created successfully
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4f8374-91de-44f0-b311-65fa48c19f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Flow 'volume_create_manager' (f7e7cf4a-ec44-4454-976b-2e70e268f1ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:47 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-7b7543c3-a9fb-4d3b-b64d-413e4bbdedaf tempest-VolumesTestJSON-1933600037 None] Created volume successfully.
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Flow 'volume_create_manager' (6cf589d2-c8db-4d58-90fb-f97641875866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc8286e-6076-469b-89b8-111779ff5bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc8286e-6076-469b-89b8-111779ff5bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1183884794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a21727f-2f87-41f5-897f-41377de30f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86a7f397ebfd4b24bafaff427fd740c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:48Z,use_quota=True,user_id='1c5a4e963b5049368410dc843f24856a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a083420-a619-415b-a6c6-6f75f964bb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a083420-a619-415b-a6c6-6f75f964bb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f698393-f1fd-4a7f-ae66-08b3b5e151a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f698393-f1fd-4a7f-ae66-08b3b5e151a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a21727f-2f87-41f5-897f-41377de30f6e', 'volume_name': 'volume-9a21727f-2f87-41f5-897f-41377de30f6e', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db216ad8-aa66-4f26-a77b-13e72629b483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db216ad8-aa66-4f26-a77b-13e72629b483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba945fd0-cc1a-44d2-8dfb-2de6bfcc7aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:47 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume 9a21727f-2f87-41f5-897f-41377de30f6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a21727f-2f87-41f5-897f-41377de30f6e', 'volume_size': 1}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1183884794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a21727f-2f87-41f5-897f-41377de30f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86a7f397ebfd4b24bafaff427fd740c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:48Z,use_quota=True,user_id='1c5a4e963b5049368410dc843f24856a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Creating volume 9a21727f-2f87-41f5-897f-41377de30f6e {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:12:47 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:12:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9a21727f-2f87-41f5-897f-41377de30f6e 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:47 devstack sudo[98263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9a21727f-2f87-41f5-897f-41377de30f6e 1073741824
Jun 06 01:12:47 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Flow 'volume_create_manager' (748b8cd1-c47f-4f6a-a26e-79c827fa9b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642b8a19-9864-4ec3-8bc9-64834e052c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642b8a19-9864-4ec3-8bc9-64834e052c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-68194071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb682fc-6069-4b8f-8798-2ed4f8e3aef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86a7f397ebfd4b24bafaff427fd740c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:48Z,use_quota=True,user_id='1c5a4e963b5049368410dc843f24856a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bb05b7-2fd9-4b84-be79-b8dfed5339ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bb05b7-2fd9-4b84-be79-b8dfed5339ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7d40ef-fc13-469e-935b-ded0fe34fb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7d40ef-fc13-469e-935b-ded0fe34fb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eb682fc-6069-4b8f-8798-2ed4f8e3aef2', 'volume_name': 'volume-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b80b7c-a6b8-4892-8d05-523f29b5d59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b80b7c-a6b8-4892-8d05-523f29b5d59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5a8b5d-eec7-41e0-bd03-8d29f95c2813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:48 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume 8eb682fc-6069-4b8f-8798-2ed4f8e3aef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2', 'volume_size': 1}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Flow 'volume_create_manager' (96192b70-0bbb-4883-93b4-4ee1c5a78745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62731532-2d6e-46ca-a78d-f248d1eb3f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62731532-2d6e-46ca-a78d-f248d1eb3f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1983373287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035df15a-a210-4e54-b198-6aa1b7f34af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86a7f397ebfd4b24bafaff427fd740c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:49Z,use_quota=True,user_id='1c5a4e963b5049368410dc843f24856a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682199e4-8c03-497d-a398-7b06ea416371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682199e4-8c03-497d-a398-7b06ea416371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfab3c16-0141-41c5-91a7-0e0d69f22235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfab3c16-0141-41c5-91a7-0e0d69f22235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '035df15a-a210-4e54-b198-6aa1b7f34af1', 'volume_name': 'volume-035df15a-a210-4e54-b198-6aa1b7f34af1', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd48b077-5a99-4d45-99df-5b629edd81e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd48b077-5a99-4d45-99df-5b629edd81e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80cfc595-6a21-441d-b9d3-692d0a974bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:48 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume 035df15a-a210-4e54-b198-6aa1b7f34af1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-035df15a-a210-4e54-b198-6aa1b7f34af1', 'volume_size': 1}
Jun 06 01:12:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Flow 'volume_create_manager' (734a5529-106b-4bd3-b48f-af1dd5be5f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0487de-2707-410d-b768-4a5591c6da41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:49 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0487de-2707-410d-b768-4a5591c6da41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482092119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=373927fa-fc57-47a6-9a79-aeb19e5bcf33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86a7f397ebfd4b24bafaff427fd740c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:49Z,use_quota=True,user_id='1c5a4e963b5049368410dc843f24856a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c565d81b-1465-48ab-ac29-1511e78f1cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c565d81b-1465-48ab-ac29-1511e78f1cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78f7731-5d62-4c80-a8ec-5f2a15de7c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78f7731-5d62-4c80-a8ec-5f2a15de7c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '373927fa-fc57-47a6-9a79-aeb19e5bcf33', 'volume_name': 'volume-373927fa-fc57-47a6-9a79-aeb19e5bcf33', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adeb3e6e-ac5a-4d00-9fa1-58d25f8b26b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adeb3e6e-ac5a-4d00-9fa1-58d25f8b26b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e22fa39-dbab-49f2-b980-21fe90e78576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:49 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume 373927fa-fc57-47a6-9a79-aeb19e5bcf33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-373927fa-fc57-47a6-9a79-aeb19e5bcf33', 'volume_size': 1}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9a21727f-2f87-41f5-897f-41377de30f6e 1073741824" returned: 0 in 1.203s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9a21727f-2f87-41f5-897f-41377de30f6e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:49 devstack sudo[98270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9a21727f-2f87-41f5-897f-41377de30f6e
Jun 06 01:12:49 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] Acquiring lock "cinder-1b63594e-b78a-422b-8bcf-17fce06f8b7e-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] Lock "cinder-1b63594e-b78a-422b-8bcf-17fce06f8b7e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] Acquiring lock "cinder-quobyte-1b63594e-b78a-422b-8bcf-17fce06f8b7e" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] Lock "cinder-quobyte-1b63594e-b78a-422b-8bcf-17fce06f8b7e" acquired by "delete_volume" :: waited 0.046s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d532a1-fb77-44f0-8714-d3c538dfa607]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1b63594e-b78a-422b-8bcf-17fce06f8b7e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Flow 'volume_create_manager' (93ab7ce4-494e-49b6-a1ed-ee00903bebba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f4da51-7e25-49f5-b14b-5499a3ff7ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f4da51-7e25-49f5-b14b-5499a3ff7ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-756522876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c13def35-73dd-4ec4-87f0-0b6e5aee389b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86a7f397ebfd4b24bafaff427fd740c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:49Z,use_quota=True,user_id='1c5a4e963b5049368410dc843f24856a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8898db-b1f3-4271-832f-61ad58aed94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:49 devstack sudo[98272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1b63594e-b78a-422b-8bcf-17fce06f8b7e
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8898db-b1f3-4271-832f-61ad58aed94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:49 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdce7a4-3306-4418-af49-9a96b8424382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdce7a4-3306-4418-af49-9a96b8424382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c13def35-73dd-4ec4-87f0-0b6e5aee389b', 'volume_name': 'volume-c13def35-73dd-4ec4-87f0-0b6e5aee389b', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e73116f-965a-41fe-926a-50925b249b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e73116f-965a-41fe-926a-50925b249b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddcfd643-9594-4eb0-9ba2-da56df41c229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:49 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume c13def35-73dd-4ec4-87f0-0b6e5aee389b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c13def35-73dd-4ec4-87f0-0b6e5aee389b', 'volume_size': 1}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:49 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9a21727f-2f87-41f5-897f-41377de30f6e" returned: 0 in 0.703s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-68194071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb682fc-6069-4b8f-8798-2ed4f8e3aef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86a7f397ebfd4b24bafaff427fd740c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:48Z,use_quota=True,user_id='1c5a4e963b5049368410dc843f24856a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Creating volume 8eb682fc-6069-4b8f-8798-2ed4f8e3aef2 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:12:49 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba945fd0-cc1a-44d2-8dfb-2de6bfcc7aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a21727f-2f87-41f5-897f-41377de30f6e', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ed1895-eb80-4169-97ef-26caebc4009b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:49 devstack sudo[98275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2 1073741824
Jun 06 01:12:49 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:49 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume volume-9a21727f-2f87-41f5-897f-41377de30f6e (9a21727f-2f87-41f5-897f-41377de30f6e): created successfully
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ed1895-eb80-4169-97ef-26caebc4009b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Flow 'volume_create_manager' (6cf589d2-c8db-4d58-90fb-f97641875866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:49 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-7b6eb2b4-f6dc-4e66-8c33-64af56139549 tempest-CreateVolumesFromSnapshotTest-87833567 None] Created volume successfully.
Jun 06 01:12:50 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1b63594e-b78a-422b-8bcf-17fce06f8b7e" returned: 0 in 0.787s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1b63594e-b78a-422b-8bcf-17fce06f8b7e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:50 devstack sudo[98280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1b63594e-b78a-422b-8bcf-17fce06f8b7e
Jun 06 01:12:50 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:50 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2 1073741824" returned: 0 in 0.819s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:50 devstack sudo[98287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2
Jun 06 01:12:50 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:50 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1b63594e-b78a-422b-8bcf-17fce06f8b7e" returned: 0 in 0.639s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:50 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] Lock "cinder-quobyte-1b63594e-b78a-422b-8bcf-17fce06f8b7e" released by "delete_volume" :: held 1.489s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:12:50 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] Created reservations ['1bc18d6d-d31e-4b7c-97bd-560aeee15dda', '76d40f3a-212d-4bf7-a82b-9f80fe9c24c9', '06f64112-0222-478f-9344-e62ff53227c8', '4c96dd61-10be-4d96-b4eb-cbe458273d93'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:12:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:50 devstack sudo[98289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:12:50 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:51 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2" returned: 0 in 0.631s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.659s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1983373287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035df15a-a210-4e54-b198-6aa1b7f34af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86a7f397ebfd4b24bafaff427fd740c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:49Z,use_quota=True,user_id='1c5a4e963b5049368410dc843f24856a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Creating volume 035df15a-a210-4e54-b198-6aa1b7f34af1 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:12:51 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-035df15a-a210-4e54-b198-6aa1b7f34af1 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5a8b5d-eec7-41e0-bd03-8d29f95c2813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52c6474-9cef-463f-8bed-0c23aa7438e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:51 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume volume-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2 (8eb682fc-6069-4b8f-8798-2ed4f8e3aef2): created successfully
Jun 06 01:12:51 devstack sudo[98292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-035df15a-a210-4e54-b198-6aa1b7f34af1 1073741824
Jun 06 01:12:51 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52c6474-9cef-463f-8bed-0c23aa7438e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Flow 'volume_create_manager' (748b8cd1-c47f-4f6a-a26e-79c827fa9b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:51 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-7b2f794c-2fef-4612-948a-386cafe4ad45 tempest-CreateVolumesFromSnapshotTest-87833567 None] Created volume successfully.
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] Acquiring lock "cinder-8ed83f09-b448-460f-8f31-f8f5c3669f3e-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] Lock "cinder-8ed83f09-b448-460f-8f31-f8f5c3669f3e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] Acquiring lock "cinder-quobyte-8ed83f09-b448-460f-8f31-f8f5c3669f3e" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] Lock "cinder-quobyte-8ed83f09-b448-460f-8f31-f8f5c3669f3e" acquired by "delete_volume" :: waited 0.026s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:51 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.693s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:12:51 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] Deleted volume successfully.
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5248e7b-b36e-4d5e-8a9b-8bff19ff91a9]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ed83f09-b448-460f-8f31-f8f5c3669f3e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-52be1603-01fc-4be9-ba60-51535aca490c tempest-VolumesTestJSON-1933600037 None] Lock "cinder-1b63594e-b78a-422b-8bcf-17fce06f8b7e-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:12:51 devstack sudo[98295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ed83f09-b448-460f-8f31-f8f5c3669f3e
Jun 06 01:12:51 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:52 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-035df15a-a210-4e54-b198-6aa1b7f34af1 1073741824" returned: 0 in 1.021s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-035df15a-a210-4e54-b198-6aa1b7f34af1 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:52 devstack sudo[98304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-035df15a-a210-4e54-b198-6aa1b7f34af1
Jun 06 01:12:52 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:52 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ed83f09-b448-460f-8f31-f8f5c3669f3e" returned: 0 in 0.855s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ed83f09-b448-460f-8f31-f8f5c3669f3e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:52 devstack sudo[98306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ed83f09-b448-460f-8f31-f8f5c3669f3e
Jun 06 01:12:52 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:53 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-035df15a-a210-4e54-b198-6aa1b7f34af1" returned: 0 in 0.660s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.004s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482092119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=373927fa-fc57-47a6-9a79-aeb19e5bcf33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86a7f397ebfd4b24bafaff427fd740c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:49Z,use_quota=True,user_id='1c5a4e963b5049368410dc843f24856a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Creating volume 373927fa-fc57-47a6-9a79-aeb19e5bcf33 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:12:53 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-373927fa-fc57-47a6-9a79-aeb19e5bcf33 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80cfc595-6a21-441d-b9d3-692d0a974bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-035df15a-a210-4e54-b198-6aa1b7f34af1', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:53 devstack sudo[98311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-373927fa-fc57-47a6-9a79-aeb19e5bcf33 1073741824
Jun 06 01:12:53 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330c20e8-8d2d-4ff3-99f3-1dd6d40ad12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:53 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume volume-035df15a-a210-4e54-b198-6aa1b7f34af1 (035df15a-a210-4e54-b198-6aa1b7f34af1): created successfully
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330c20e8-8d2d-4ff3-99f3-1dd6d40ad12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Flow 'volume_create_manager' (96192b70-0bbb-4883-93b4-4ee1c5a78745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:53 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8ed83f09-b448-460f-8f31-f8f5c3669f3e" returned: 0 in 0.668s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] Lock "cinder-quobyte-8ed83f09-b448-460f-8f31-f8f5c3669f3e" released by "delete_volume" :: held 1.614s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:12:53 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-a5d1b934-fbd6-416d-b81c-fbae57c6642b tempest-CreateVolumesFromSnapshotTest-87833567 None] Created volume successfully.
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] Created reservations ['703f467d-21ae-40cd-b9da-bdd85cf8cd18', 'a6ad91b0-60be-4be0-9e2d-3b9f639b1782', '4b8014cd-5393-4358-a829-c6578e0927a8', '3250bd9b-a6ee-4819-b7e1-14562e7618c4'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:53 devstack sudo[98313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:12:53 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] Acquiring lock "cinder-5f2f10bf-d168-43a3-b947-5eaeb3960b36-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] Lock "cinder-5f2f10bf-d168-43a3-b947-5eaeb3960b36-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] Acquiring lock "cinder-quobyte-5f2f10bf-d168-43a3-b947-5eaeb3960b36" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] Lock "cinder-quobyte-5f2f10bf-d168-43a3-b947-5eaeb3960b36" acquired by "delete_volume" :: waited 0.031s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[112db774-fb94-4f31-a19d-822fc6832b59]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:12:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5f2f10bf-d168-43a3-b947-5eaeb3960b36 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:54 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.714s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:12:54 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] Deleted volume successfully.
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-91caf6c2-87ea-42ac-a52d-f28ee06ea780 tempest-VolumesTestJSON-1933600037 None] Lock "cinder-8ed83f09-b448-460f-8f31-f8f5c3669f3e-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:12:54 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-373927fa-fc57-47a6-9a79-aeb19e5bcf33 1073741824" returned: 0 in 0.976s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:54 devstack sudo[98320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5f2f10bf-d168-43a3-b947-5eaeb3960b36
Jun 06 01:12:54 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-373927fa-fc57-47a6-9a79-aeb19e5bcf33 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:54 devstack sudo[98322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-373927fa-fc57-47a6-9a79-aeb19e5bcf33
Jun 06 01:12:54 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:54 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-373927fa-fc57-47a6-9a79-aeb19e5bcf33" returned: 0 in 0.637s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.199s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-756522876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c13def35-73dd-4ec4-87f0-0b6e5aee389b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86a7f397ebfd4b24bafaff427fd740c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:12:49Z,use_quota=True,user_id='1c5a4e963b5049368410dc843f24856a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Creating volume c13def35-73dd-4ec4-87f0-0b6e5aee389b {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:12:54 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:12:54 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c13def35-73dd-4ec4-87f0-0b6e5aee389b 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5f2f10bf-d168-43a3-b947-5eaeb3960b36" returned: 0 in 0.821s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5f2f10bf-d168-43a3-b947-5eaeb3960b36 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:54 devstack sudo[98331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c13def35-73dd-4ec4-87f0-0b6e5aee389b 1073741824
Jun 06 01:12:54 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e22fa39-dbab-49f2-b980-21fe90e78576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-373927fa-fc57-47a6-9a79-aeb19e5bcf33', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:54 devstack sudo[98332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5f2f10bf-d168-43a3-b947-5eaeb3960b36
Jun 06 01:12:54 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857e96c7-a371-40ae-b198-abcab2b3ad83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:54 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume volume-373927fa-fc57-47a6-9a79-aeb19e5bcf33 (373927fa-fc57-47a6-9a79-aeb19e5bcf33): created successfully
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857e96c7-a371-40ae-b198-abcab2b3ad83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Flow 'volume_create_manager' (734a5529-106b-4bd3-b48f-af1dd5be5f05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:54 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c91d8b2c-edb1-441d-9d98-5c72bcedabb9 tempest-CreateVolumesFromSnapshotTest-87833567 None] Created volume successfully.
Jun 06 01:12:55 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5f2f10bf-d168-43a3-b947-5eaeb3960b36" returned: 0 in 0.663s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:55 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] Lock "cinder-quobyte-5f2f10bf-d168-43a3-b947-5eaeb3960b36" released by "delete_volume" :: held 1.530s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:12:55 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] Created reservations ['8f76fa1a-fd2d-4b1e-a184-673b53d69533', 'c8435a93-8f0e-42d8-9f5d-b4d559d76b89', 'f02455f6-3749-4f1d-bfed-f03dd589b29b', 'd426d4a6-3abb-4e19-a943-1ce9d9d23f48'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:12:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:55 devstack sudo[98340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:12:55 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:55 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c13def35-73dd-4ec4-87f0-0b6e5aee389b 1073741824" returned: 0 in 0.849s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c13def35-73dd-4ec4-87f0-0b6e5aee389b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:55 devstack sudo[98342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c13def35-73dd-4ec4-87f0-0b6e5aee389b
Jun 06 01:12:55 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:56 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.646s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:56 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:12:56 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] Deleted volume successfully.
Jun 06 01:12:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-00bc5126-8027-4355-8dbf-8a7add83ec2c tempest-VolumesTestJSON-1933600037 None] Lock "cinder-5f2f10bf-d168-43a3-b947-5eaeb3960b36-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:12:56 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c13def35-73dd-4ec4-87f0-0b6e5aee389b" returned: 0 in 0.645s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:12:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddcfd643-9594-4eb0-9ba2-da56df41c229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c13def35-73dd-4ec4-87f0-0b6e5aee389b', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7e6f61-0b9f-462a-a4b4-2284b65b5ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:12:56 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Volume volume-c13def35-73dd-4ec4-87f0-0b6e5aee389b (c13def35-73dd-4ec4-87f0-0b6e5aee389b): created successfully
Jun 06 01:12:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7e6f61-0b9f-462a-a4b4-2284b65b5ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:12:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Flow 'volume_create_manager' (93ab7ce4-494e-49b6-a1ed-ee00903bebba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:12:56 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d896e2e8-d5da-4665-9f64-e287b9033011 tempest-CreateVolumesFromSnapshotTest-87833567 None] Created volume successfully.
Jun 06 01:12:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "cinder-c13def35-73dd-4ec4-87f0-0b6e5aee389b-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-c13def35-73dd-4ec4-87f0-0b6e5aee389b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "cinder-quobyte-c13def35-73dd-4ec4-87f0-0b6e5aee389b" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-quobyte-c13def35-73dd-4ec4-87f0-0b6e5aee389b" acquired by "delete_volume" :: waited 0.037s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:57 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0387e88-2c18-47bb-962d-265cd5ea73d9]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:12:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c13def35-73dd-4ec4-87f0-0b6e5aee389b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:57 devstack sudo[98346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c13def35-73dd-4ec4-87f0-0b6e5aee389b
Jun 06 01:12:57 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:58 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c13def35-73dd-4ec4-87f0-0b6e5aee389b" returned: 0 in 0.726s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c13def35-73dd-4ec4-87f0-0b6e5aee389b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:58 devstack sudo[98351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c13def35-73dd-4ec4-87f0-0b6e5aee389b
Jun 06 01:12:58 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:58 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c13def35-73dd-4ec4-87f0-0b6e5aee389b" returned: 0 in 0.610s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-quobyte-c13def35-73dd-4ec4-87f0-0b6e5aee389b" released by "delete_volume" :: held 1.383s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:12:58 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] Created reservations ['39d6732c-e2e5-4fca-8b85-eb42694d89e7', '17a81d07-0932-4f73-9469-877b6d2f0f4d', 'b14a281c-d6f5-46c6-a07e-af114d288c11', '842b9cb5-f667-4f67-8cf7-ff3eb4fd0220'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:12:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:58 devstack sudo[98354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:12:58 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:12:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:12:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:12:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:12:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:12:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:12:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:59 devstack sudo[98356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:12:59 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:12:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "cinder-373927fa-fc57-47a6-9a79-aeb19e5bcf33-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-373927fa-fc57-47a6-9a79-aeb19e5bcf33-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "cinder-quobyte-373927fa-fc57-47a6-9a79-aeb19e5bcf33" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:12:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-quobyte-373927fa-fc57-47a6-9a79-aeb19e5bcf33" acquired by "delete_volume" :: waited 0.029s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:12:59 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a960f9-c036-4d21-a358-73c3978c5daa]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:12:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-373927fa-fc57-47a6-9a79-aeb19e5bcf33 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:12:59 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root
Jun 06 01:12:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.938s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:12:59 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:12:59 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] Deleted volume successfully.
Jun 06 01:12:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-867f0771-4ce1-4584-a3be-c277b6de92e0 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-c13def35-73dd-4ec4-87f0-0b6e5aee389b-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:00 devstack sudo[98359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-373927fa-fc57-47a6-9a79-aeb19e5bcf33
Jun 06 01:13:00 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:00 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.823s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:13:00 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b586d5c8-8b17-4179-b86c-93d4c94999dd tempest-GroupSnapshotsTest-1783584790 None] Group tempest-GroupSnapshotsTest-Group-941799263: creating
Jun 06 01:13:00 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b586d5c8-8b17-4179-b86c-93d4c94999dd tempest-GroupSnapshotsTest-1783584790 None] Group tempest-GroupSnapshotsTest-Group-941799263: created successfully
Jun 06 01:13:00 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b586d5c8-8b17-4179-b86c-93d4c94999dd tempest-GroupSnapshotsTest-1783584790 None] Create group completed successfully.
Jun 06 01:13:00 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-373927fa-fc57-47a6-9a79-aeb19e5bcf33" returned: 0 in 0.934s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-373927fa-fc57-47a6-9a79-aeb19e5bcf33 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:00 devstack sudo[98366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-373927fa-fc57-47a6-9a79-aeb19e5bcf33
Jun 06 01:13:00 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:01 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-373927fa-fc57-47a6-9a79-aeb19e5bcf33" returned: 0 in 0.674s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-quobyte-373927fa-fc57-47a6-9a79-aeb19e5bcf33" released by "delete_volume" :: held 1.661s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] Created reservations ['3022ecb2-a537-452a-b669-06589e28523d', '71e4c249-91cf-4246-be76-f215b4a173bf', '5a862531-c9b7-4540-a760-d02490cc1497', '39e4716d-7f36-41dd-8078-38b5efc3f5af'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:01 devstack sudo[98380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:13:01 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Flow 'volume_create_manager' (3087d786-3f04-4846-9f5d-af87893188c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a59ace-8b35-4817-b318-4ad73287fd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a59ace-8b35-4817-b318-4ad73287fd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1455770444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1ee5cb8a-66cd-48c2-b3a5-c4dbe3730235,host='devstack@QuobyteHD#QuobyteHD',id=d0abbdf1-30ad-46f7-9eb2-576ab4e9e822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3486bade41c040ca8681beffa0676c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:13:02Z,use_quota=True,user_id='5a4b8e90217f4714a9c4c32c889c82ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ec2bbb1-cd4f-485a-9382-c24c9c56770f),volume_type_id=1ec2bbb1-cd4f-485a-9382-c24c9c56770f)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3184b16f-ec8e-4548-9737-5e71e72bacb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3184b16f-ec8e-4548-9737-5e71e72bacb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6975032-e61f-4b93-ab46-eb5ac10d0b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6975032-e61f-4b93-ab46-eb5ac10d0b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0abbdf1-30ad-46f7-9eb2-576ab4e9e822', 'volume_name': 'volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30fd96a0-dc97-49e4-9fee-95c2760f2d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30fd96a0-dc97-49e4-9fee-95c2760f2d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964cf769-bf1f-4198-aaf5-db0702bc0f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:01 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Volume d0abbdf1-30ad-46f7-9eb2-576ab4e9e822: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822', 'volume_size': 1}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1ee5cb8a-66cd-48c2-b3a5-c4dbe3730235,created_at=2026-06-05T23:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1455770444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1ee5cb8a-66cd-48c2-b3a5-c4dbe3730235,host='devstack@QuobyteHD#QuobyteHD',id=d0abbdf1-30ad-46f7-9eb2-576ab4e9e822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3486bade41c040ca8681beffa0676c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:13:02Z,use_quota=True,user_id='5a4b8e90217f4714a9c4c32c889c82ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ec2bbb1-cd4f-485a-9382-c24c9c56770f),volume_type_id=1ec2bbb1-cd4f-485a-9382-c24c9c56770f)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Creating volume d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:13:01 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:13:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:01 devstack sudo[98387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 1073741824
Jun 06 01:13:01 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:02 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "cinder-035df15a-a210-4e54-b198-6aa1b7f34af1-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:02 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-035df15a-a210-4e54-b198-6aa1b7f34af1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:02 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "cinder-quobyte-035df15a-a210-4e54-b198-6aa1b7f34af1" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:02 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-quobyte-035df15a-a210-4e54-b198-6aa1b7f34af1" acquired by "delete_volume" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:02 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[37aab2f5-6e36-48e4-86c7-e038dd5c0cfc]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-035df15a-a210-4e54-b198-6aa1b7f34af1 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:02 devstack sudo[98389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-035df15a-a210-4e54-b198-6aa1b7f34af1
Jun 06 01:13:02 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:02 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.773s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:02 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:13:02 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] Deleted volume successfully.
Jun 06 01:13:02 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-27d69c8f-7b40-4ddf-b4a4-b0417f8d2a17 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-373927fa-fc57-47a6-9a79-aeb19e5bcf33-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:02 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 1073741824" returned: 0 in 0.883s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:02 devstack sudo[98399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822
Jun 06 01:13:02 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:02 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-035df15a-a210-4e54-b198-6aa1b7f34af1" returned: 0 in 0.768s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-035df15a-a210-4e54-b198-6aa1b7f34af1 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:02 devstack sudo[98401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-035df15a-a210-4e54-b198-6aa1b7f34af1
Jun 06 01:13:02 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:03 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822" returned: 0 in 0.626s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:13:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964cf769-bf1f-4198-aaf5-db0702bc0f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d27c246-9af3-48ad-bc2b-cf6be5c34900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:03 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Volume volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 (d0abbdf1-30ad-46f7-9eb2-576ab4e9e822): created successfully
Jun 06 01:13:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d27c246-9af3-48ad-bc2b-cf6be5c34900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Flow 'volume_create_manager' (3087d786-3f04-4846-9f5d-af87893188c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:13:03 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-23ff6387-5579-4f7a-8d40-5d6e1cbda14d tempest-GroupSnapshotsTest-1783584790 None] Created volume successfully.
Jun 06 01:13:03 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-035df15a-a210-4e54-b198-6aa1b7f34af1" returned: 0 in 0.649s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-quobyte-035df15a-a210-4e54-b198-6aa1b7f34af1" released by "delete_volume" :: held 1.462s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:03 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] Created reservations ['606fdf18-9c18-4c5c-a3f0-23e8512a81a5', 'a2471201-dd82-4781-ae38-de20f778d9d1', 'd3743d11-87bf-40ac-bcac-f5640c695181', '1f0cb525-40c2-4f8a-9af6-1abf0f6f6660'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:13:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:13:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:13:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:03 devstack sudo[98405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:13:03 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:04 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] GroupSnapshot 5654bda5-33f9-4650-a51a-44eff22ce7f8: creating.
Jun 06 01:13:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] Group snapshot 5654bda5-33f9-4650-a51a-44eff22ce7f8: creating. {{(pid=86581) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 06 01:13:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] Creating offline snapshot af524e89-0f64-44ba-a6f9-dd970ddaeaa8 of volume d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:13:04 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[04210a34-c1e7-43bf-9e14-b044eebca8e1]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:04 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.600s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:04 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:13:04 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] Deleted volume successfully.
Jun 06 01:13:04 devstack sudo[98408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822
Jun 06 01:13:04 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-82913c91-cad0-43ec-a2dd-4340348a1265 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-035df15a-a210-4e54-b198-6aa1b7f34af1-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "cinder-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "cinder-quobyte-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-quobyte-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2" acquired by "delete_volume" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:04 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb320414-3baf-4efd-9ad7-b756bf8e7eb5]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:04 devstack sudo[98410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2
Jun 06 01:13:04 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:04 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822" returned: 0 in 0.752s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:04 devstack sudo[98419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8 1G
Jun 06 01:13:04 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:05 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2" returned: 0 in 0.789s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:05 devstack sudo[98424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2
Jun 06 01:13:05 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:05 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8 1G" returned: 0 in 0.829s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:05 devstack sudo[98430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8
Jun 06 01:13:05 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:05 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2" returned: 0 in 0.633s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-quobyte-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2" released by "delete_volume" :: held 1.469s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:05 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] Created reservations ['c5351711-c9de-4f91-b948-fdd3c14e95e7', '1ae47da2-8887-4b93-afd2-b72758c47d35', '591f527f-4be5-40b1-9831-b587ea8b490c', '3bba45d8-41c4-4265-933e-0f090d68f056'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:13:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:13:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:13:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:06 devstack sudo[98432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:13:06 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "cinder-9a21727f-2f87-41f5-897f-41377de30f6e-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:06 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8" returned: 0 in 0.942s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:06 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8 is being set with open permissions: ugo+rw: NotImplementedError
Jun 06 01:13:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-9a21727f-2f87-41f5-897f-41377de30f6e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:06 devstack sudo[98487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8
Jun 06 01:13:06 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "cinder-quobyte-9a21727f-2f87-41f5-897f-41377de30f6e" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-quobyte-9a21727f-2f87-41f5-897f-41377de30f6e" acquired by "delete_volume" :: waited 0.029s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:06 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9ec6a1-23d0-4872-a262-66f4103f8752]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9a21727f-2f87-41f5-897f-41377de30f6e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:07 devstack sudo[98493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9a21727f-2f87-41f5-897f-41377de30f6e
Jun 06 01:13:07 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:07 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.262s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:07 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:13:07 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] Deleted volume successfully.
Jun 06 01:13:07 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cea5e781-12f1-4fcf-bae6-388342de3320 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-8eb682fc-6069-4b8f-8798-2ed4f8e3aef2-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:07 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8" returned: 0 in 0.951s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:07 devstack sudo[98507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.info
Jun 06 01:13:07 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:07 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9a21727f-2f87-41f5-897f-41377de30f6e" returned: 0 in 1.008s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9a21727f-2f87-41f5-897f-41377de30f6e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:07 devstack sudo[98512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9a21727f-2f87-41f5-897f-41377de30f6e
Jun 06 01:13:07 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:08 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.info" returned: 0 in 0.675s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:08 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 06 01:13:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:08 devstack sudo[98515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.info
Jun 06 01:13:08 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:08 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9a21727f-2f87-41f5-897f-41377de30f6e" returned: 0 in 0.700s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:08 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-quobyte-9a21727f-2f87-41f5-897f-41377de30f6e" released by "delete_volume" :: held 1.815s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:08 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] Created reservations ['54d9bb56-de37-4983-8f36-e7d29fcf2e1e', 'a2661136-d778-4e0c-9d7e-d11847327a41', '90b8eefc-b963-4bcb-88ee-1b25b1793047', 'ecf0e961-141e-4a10-b496-cbd82a440be7'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:13:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:13:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:13:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:08 devstack sudo[98518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:13:08 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "cinder-ce728007-6172-4531-bf34-709cc8d7db85-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-ce728007-6172-4531-bf34-709cc8d7db85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "cinder-quobyte-f61e66d8-8f5a-421c-a568-3434d4c25c3f" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-quobyte-f61e66d8-8f5a-421c-a568-3434d4c25c3f" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "cinder-quobyte-ce728007-6172-4531-bf34-709cc8d7db85" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-quobyte-ce728007-6172-4531-bf34-709cc8d7db85" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] Deleting offline snapshot ce728007-6172-4531-bf34-709cc8d7db85 of volume f61e66d8-8f5a-421c-a568-3434d4c25c3f {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:13:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] snapshot_file for this snap is: volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:13:09 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0975f1-e2a6-4a37-9f1e-d854420cb7ce]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:09 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.info" returned: 0 in 0.807s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.070s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:09 devstack sudo[98521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85
Jun 06 01:13:09 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:09 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d6fdcc36-542a-494d-a4b5-75042fecc68a tempest-GroupSnapshotsTest-1783584790 None] group_snapshot 5654bda5-33f9-4650-a51a-44eff22ce7f8: created successfully
Jun 06 01:13:09 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.747s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:09 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:13:09 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] Deleted volume successfully.
Jun 06 01:13:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-adddfc27-575b-4771-9bcf-00ff0a2d4d33 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-9a21727f-2f87-41f5-897f-41377de30f6e-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:10 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85" returned: 0 in 0.867s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:13:10 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[01736764-f98e-45f4-8311-cd5f4372bf8e]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:10 devstack sudo[98527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f
Jun 06 01:13:10 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:10 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f" returned: 0 in 0.835s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:10 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "cinder-quobyte-af524e89-0f64-44ba-a6f9-dd970ddaeaa8-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a" by "_create_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:10 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-af524e89-0f64-44ba-a6f9-dd970ddaeaa8-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Creating volume 57b0eee6-e80c-48bb-b34d-8921ee9b6e7a from snapshot af524e89-0f64-44ba-a6f9-dd970ddaeaa8 {{(pid=86581) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:13:11 devstack sudo[98566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85
Jun 06 01:13:11 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "cinder-quobyte-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a" by "_copy_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] snapshot: af524e89-0f64-44ba-a6f9-dd970ddaeaa8, volume: 57b0eee6-e80c-48bb-b34d-8921ee9b6e7a,  {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[454c31ed-6ba8-4549-9818-2097de30a2dd]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:11 devstack sudo[98568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8
Jun 06 01:13:11 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:11 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85" returned: 0 in 1.006s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:11 devstack sudo[98577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85
Jun 06 01:13:11 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:12 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8" returned: 0 in 0.939s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:13:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 06 01:13:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Creating direct copy from snapshot {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 06 01:13:12 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1786361-7c13-40a7-b50d-cdd2d7ce7976]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:12 devstack sudo[98582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822
Jun 06 01:13:12 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:12 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f.ce728007-6172-4531-bf34-709cc8d7db85" returned: 0 in 0.647s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-quobyte-ce728007-6172-4531-bf34-709cc8d7db85" released by "_delete_snapshot" :: held 3.493s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-quobyte-f61e66d8-8f5a-421c-a568-3434d4c25c3f" released by "delete_snapshot" :: held 3.535s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:12 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] Created reservations ['c031f68e-f59a-47c6-ba7d-93e2a34bd0ad', '3ea06af5-b006-4a1a-baab-aab9763aec96', '41f92916-1138-454b-b46c-2f0565e87b97', '940e4b63-e652-4889-a3f3-748ab6f79c86'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:13:12 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] Delete snapshot completed successfully.
Jun 06 01:13:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7b1fb17f-bcab-45ea-b4cf-0e22523593c7 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-ce728007-6172-4531-bf34-709cc8d7db85-delete_snapshot" released by "delete_snapshot" :: held 3.706s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:13 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822" returned: 0 in 0.879s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:13 devstack cinder-volume[86581]: DEBUG cinder.utils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Path /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a not found in is_blk_device check {{(pid=86581) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jun 06 01:13:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:13 devstack sudo[98589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a
Jun 06 01:13:13 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "cinder-f61e66d8-8f5a-421c-a568-3434d4c25c3f-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-f61e66d8-8f5a-421c-a568-3434d4c25c3f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "cinder-quobyte-f61e66d8-8f5a-421c-a568-3434d4c25c3f" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-quobyte-f61e66d8-8f5a-421c-a568-3434d4c25c3f" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:13 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[f196094e-371f-48cb-8458-1d46d19b412b]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:13 devstack sudo[98593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f
Jun 06 01:13:13 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:15 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f" returned: 0 in 1.604s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:15 devstack sudo[98606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f
Jun 06 01:13:15 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:16 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f61e66d8-8f5a-421c-a568-3434d4c25c3f" returned: 0 in 1.785s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-quobyte-f61e66d8-8f5a-421c-a568-3434d4c25c3f" released by "delete_volume" :: held 3.494s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:17 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] Created reservations ['67acdaca-18e6-4c06-b26c-31e7c8e82fea', '0cdcbff2-ae8c-47be-8ab8-7159f0c42f4d', 'd8552831-7da1-4fed-9953-7e6803a3ad9f', 'f72bf4a9-1a38-4f66-b9ad-f19d9f61d243'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:13:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:13:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:13:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:17 devstack sudo[98616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:13:17 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:19 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.640s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:19 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:13:19 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] Deleted volume successfully.
Jun 06 01:13:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e9653e44-6ba6-4f70-baac-19bb1ca98cc4 tempest-CreateVolumesFromSnapshotTest-87833567 None] Lock "cinder-f61e66d8-8f5a-421c-a568-3434d4c25c3f-delete_volume" released by "delete_volume" :: held 5.821s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:19 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a" returned: 0 in 6.692s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:19 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcefbba4-20f2-4735-b492-cefd65e04786]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:19 devstack sudo[98638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822
Jun 06 01:13:19 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:20 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822" returned: 0 in 0.934s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:20 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Image conversion details: src /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822, size 1024.00 MB, duration 6.69 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:13:20 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Converted 1024.00 MB image at 152.97 MB/s
Jun 06 01:13:20 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a is being set with open permissions: ugo+rw: NotImplementedError
Jun 06 01:13:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:20 devstack sudo[98644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a
Jun 06 01:13:20 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:21 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a" returned: 0 in 0.594s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a" released by "_copy_volume_from_snapshot" :: held 10.218s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-af524e89-0f64-44ba-a6f9-dd970ddaeaa8-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a" released by "_create_volume_from_snapshot" :: held 10.279s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.321s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:21 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-2d3b406b-8422-4962-9ed9-c45df2951a22 tempest-GroupSnapshotsTest-1783584790 None] Create group from source-snapshot-5654bda5-33f9-4650-a51a-44eff22ce7f8 completed successfully.
Jun 06 01:13:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "cinder-quobyte-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a" acquired by "delete_volume" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:22 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b592fe5b-5ccd-4ba2-8211-29546ba3e9f1]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:22 devstack sudo[98647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a
Jun 06 01:13:22 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:22 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a" returned: 0 in 0.689s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:22 devstack sudo[98653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a
Jun 06 01:13:22 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:23 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a" returned: 0 in 0.570s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-57b0eee6-e80c-48bb-b34d-8921ee9b6e7a" released by "delete_volume" :: held 1.295s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:23 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] Created reservations ['ac56a9fa-a164-42e3-b4c3-d61283a52a08'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:13:23 devstack cinder-volume[86581]: WARNING cinder.quota [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1978875979 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1978875979, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:13:23 devstack cinder-volume[86581]: WARNING cinder.quota [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1978875979 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1978875979, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:13:23 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] Created reservations ['026dcaf3-0821-413a-81f6-8da84863d8e1', 'f58801f5-511e-4513-a9b9-2e80c0551382', '26863517-6f4c-4e74-b95a-59146d7cbf96', '8f87dd2c-29dc-4743-951a-0a4c0669674e'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:13:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:13:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:13:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:23 devstack sudo[98658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:13:23 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:24 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.595s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:24 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:13:24 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b4093da1-eaf4-43f4-80fc-dc95719eb0ae tempest-GroupSnapshotsTest-1783584790 None] Delete group completed successfully.
Jun 06 01:13:24 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] group_snapshot 5654bda5-33f9-4650-a51a-44eff22ce7f8: deleting
Jun 06 01:13:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] group_snapshot 5654bda5-33f9-4650-a51a-44eff22ce7f8: deleting {{(pid=86581) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 06 01:13:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "cinder-quobyte-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "cinder-quobyte-af524e89-0f64-44ba-a6f9-dd970ddaeaa8" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-af524e89-0f64-44ba-a6f9-dd970ddaeaa8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] Deleting offline snapshot af524e89-0f64-44ba-a6f9-dd970ddaeaa8 of volume d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:13:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] snapshot_file for this snap is: volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:13:24 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[636017e2-262f-4db0-8ebd-65ef64488e81]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:24 devstack sudo[98661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8
Jun 06 01:13:24 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:25 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8" returned: 0 in 0.712s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:25 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:13:25 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5c8837-a90c-4b9c-aaf7-c2813738af06]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:25 devstack sudo[98666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822
Jun 06 01:13:25 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:25 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822" returned: 0 in 0.686s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:25 devstack sudo[98672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8
Jun 06 01:13:25 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:26 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8" returned: 0 in 0.675s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:26 devstack sudo[98679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8
Jun 06 01:13:26 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:27 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822.af524e89-0f64-44ba-a6f9-dd970ddaeaa8" returned: 0 in 0.576s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:27 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-af524e89-0f64-44ba-a6f9-dd970ddaeaa8" released by "_delete_snapshot" :: held 2.730s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:27 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822" released by "delete_snapshot" :: held 2.750s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:27 devstack cinder-volume[86581]: WARNING cinder.quota [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1978875979 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1978875979, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:13:27 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] Created reservations ['9c315bde-acd1-4c23-8b28-20c2fd59e6a3', 'b6d7d469-0219-43ba-b11e-3a50329afeb6', '4d989773-55fd-4ea2-a031-a232454f68d6', '7e4cee1d-4cb5-420b-9708-51f304874cc2'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:13:27 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-86d10f60-98f4-470f-aef9-cf7e06284311 tempest-GroupSnapshotsTest-1783584790 None] group_snapshot 5654bda5-33f9-4650-a51a-44eff22ce7f8: deleted successfully
Jun 06 01:13:27 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "cinder-quobyte-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:27 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822" acquired by "delete_volume" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:27 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a42c8f-7796-458b-8e4f-b4353c16d414]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:27 devstack sudo[98682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822
Jun 06 01:13:27 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:28 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822" returned: 0 in 0.697s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:28 devstack sudo[98687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822
Jun 06 01:13:28 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:29 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822" returned: 0 in 0.581s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-d0abbdf1-30ad-46f7-9eb2-576ab4e9e822" released by "delete_volume" :: held 1.356s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:29 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] Created reservations ['2d1a1b3d-ff72-4aa1-bffb-7461b6933fe1'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:13:29 devstack cinder-volume[86581]: WARNING cinder.db.sqlalchemy.api [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1978875979']
Jun 06 01:13:29 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] Created reservations ['6de43a53-2b73-429d-bbb2-d9576158e675', '7253ca12-53d0-437a-b2a6-7e1c8f705d56', '683d176c-f18c-474f-af43-91a78a76cf5f', '4817f872-39b8-41b8-bd74-261f58c960b0'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:13:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:13:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:13:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:29 devstack sudo[98690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:13:29 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:29 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.586s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:29 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:13:29 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d0d41f73-3c09-4afe-b2bf-b61fcd4e87de tempest-GroupSnapshotsTest-1783584790 None] Delete group completed successfully.
Jun 06 01:13:30 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-ea329f46-37fe-4ed6-8887-569ce1cdbf71 tempest-GroupSnapshotsTest-1783584790 None] Group tempest-GroupSnapshotsTest-Group-203422724: creating
Jun 06 01:13:30 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-ea329f46-37fe-4ed6-8887-569ce1cdbf71 tempest-GroupSnapshotsTest-1783584790 None] Group tempest-GroupSnapshotsTest-Group-203422724: created successfully
Jun 06 01:13:30 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-ea329f46-37fe-4ed6-8887-569ce1cdbf71 tempest-GroupSnapshotsTest-1783584790 None] Create group completed successfully.
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Flow 'volume_create_manager' (3dfc3c86-a286-464a-aba9-b2d09c212066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5961867b-8402-4aa7-be60-2bdc0b8c7180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5961867b-8402-4aa7-be60-2bdc0b8c7180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-55450136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9f858b-14e7-42ac-b221-e7fdd8dbabe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54037968ce94bf9a9d1162ad5e945c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:13:32Z,use_quota=True,user_id='616a9e99d38846d580ff738ea76311ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc8c7f4-1a30-4ed8-a152-339536079c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc8c7f4-1a30-4ed8-a152-339536079c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11406b4d-644d-433d-a865-47b144dcea3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11406b4d-644d-433d-a865-47b144dcea3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef9f858b-14e7-42ac-b221-e7fdd8dbabe7', 'volume_name': 'volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada21866-9771-415e-b438-eea40b88c4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada21866-9771-415e-b438-eea40b88c4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a7f534-d47c-44d2-88b0-615209f160c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:31 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Volume ef9f858b-14e7-42ac-b221-e7fdd8dbabe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7', 'volume_size': 1}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-55450136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9f858b-14e7-42ac-b221-e7fdd8dbabe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54037968ce94bf9a9d1162ad5e945c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:13:32Z,use_quota=True,user_id='616a9e99d38846d580ff738ea76311ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Creating volume ef9f858b-14e7-42ac-b221-e7fdd8dbabe7 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:13:31 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:31 devstack sudo[98695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7 1073741824
Jun 06 01:13:31 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Flow 'volume_create_manager' (5b370873-517f-490b-9ffb-d912a1a556e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c893c5-cd9e-458a-b845-010c9f318a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c893c5-cd9e-458a-b845-010c9f318a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1125369255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6a2b60f0-e30a-4655-abf1-14ae326fc42e,host='devstack@QuobyteHD#QuobyteHD',id=659746bf-34b8-4904-b02a-16d0eea29a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3486bade41c040ca8681beffa0676c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:13:32Z,use_quota=True,user_id='5a4b8e90217f4714a9c4c32c889c82ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97633f63-4c1a-410b-99d9-5f9a5f4ec610),volume_type_id=97633f63-4c1a-410b-99d9-5f9a5f4ec610)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5937bae-78c7-4717-8283-c0aae134099d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5937bae-78c7-4717-8283-c0aae134099d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb50d299-3e82-4b9f-ae6c-d533a6e2913e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb50d299-3e82-4b9f-ae6c-d533a6e2913e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '659746bf-34b8-4904-b02a-16d0eea29a63', 'volume_name': 'volume-659746bf-34b8-4904-b02a-16d0eea29a63', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a904ca3-0d2f-4dff-9823-00688f0a5601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a904ca3-0d2f-4dff-9823-00688f0a5601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d561f8c-29cf-45ca-a873-1b1d55f13105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:31 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Volume 659746bf-34b8-4904-b02a-16d0eea29a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-659746bf-34b8-4904-b02a-16d0eea29a63', 'volume_size': 1}
Jun 06 01:13:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:32 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7 1073741824" returned: 0 in 0.749s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:32 devstack sudo[98700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7
Jun 06 01:13:32 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:33 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7" returned: 0 in 0.586s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:33 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:13:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.228s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:33 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6a2b60f0-e30a-4655-abf1-14ae326fc42e,created_at=2026-06-05T23:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1125369255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6a2b60f0-e30a-4655-abf1-14ae326fc42e,host='devstack@QuobyteHD#QuobyteHD',id=659746bf-34b8-4904-b02a-16d0eea29a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3486bade41c040ca8681beffa0676c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:13:32Z,use_quota=True,user_id='5a4b8e90217f4714a9c4c32c889c82ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97633f63-4c1a-410b-99d9-5f9a5f4ec610),volume_type_id=97633f63-4c1a-410b-99d9-5f9a5f4ec610)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:13:33 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Creating volume 659746bf-34b8-4904-b02a-16d0eea29a63 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:13:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:33 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:13:33 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:13:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:33 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:13:33 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:13:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a7f534-d47c-44d2-88b0-615209f160c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:33 devstack sudo[98704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63 1073741824
Jun 06 01:13:33 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963c047f-929a-45f5-a960-d972a3f237c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:33 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Volume volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7 (ef9f858b-14e7-42ac-b221-e7fdd8dbabe7): created successfully
Jun 06 01:13:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963c047f-929a-45f5-a960-d972a3f237c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Flow 'volume_create_manager' (3dfc3c86-a286-464a-aba9-b2d09c212066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:13:33 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-9264773a-8ff4-4f8c-aa15-24ae6f8252b8 tempest-AttachVolumeNegativeTest-1679390173 None] Created volume successfully.
Jun 06 01:13:34 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63 1073741824" returned: 0 in 0.791s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:34 devstack sudo[98712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63
Jun 06 01:13:34 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:34 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63" returned: 0 in 0.585s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:34 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:13:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d561f8c-29cf-45ca-a873-1b1d55f13105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-659746bf-34b8-4904-b02a-16d0eea29a63', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdc1961-5c36-4c76-a768-fbc2709d2b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:34 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Volume volume-659746bf-34b8-4904-b02a-16d0eea29a63 (659746bf-34b8-4904-b02a-16d0eea29a63): created successfully
Jun 06 01:13:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdc1961-5c36-4c76-a768-fbc2709d2b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Flow 'volume_create_manager' (5b370873-517f-490b-9ffb-d912a1a556e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:13:34 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-2b2c74b9-87c2-4c3a-b5a6-65e2c14dbc21 tempest-GroupSnapshotsTest-1783584790 None] Created volume successfully.
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Flow 'volume_create_manager' (49861904-5b66-4cea-961a-c6e9d14af781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7543362-4bc5-4a49-9fc3-184f99e6b9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7543362-4bc5-4a49-9fc3-184f99e6b9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1862496903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6a2b60f0-e30a-4655-abf1-14ae326fc42e,host='devstack@QuobyteHD#QuobyteHD',id=c0904148-7831-47da-a37b-ddce51943ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3486bade41c040ca8681beffa0676c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:13:36Z,use_quota=True,user_id='5a4b8e90217f4714a9c4c32c889c82ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97633f63-4c1a-410b-99d9-5f9a5f4ec610),volume_type_id=97633f63-4c1a-410b-99d9-5f9a5f4ec610)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d673963c-6ae5-461c-abab-3020e02aad35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d673963c-6ae5-461c-abab-3020e02aad35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bfbbf5-8424-43b5-9552-8b52cb1b35bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bfbbf5-8424-43b5-9552-8b52cb1b35bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0904148-7831-47da-a37b-ddce51943ed5', 'volume_name': 'volume-c0904148-7831-47da-a37b-ddce51943ed5', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c0e59c-4cfe-4dd0-83db-815661ee958c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c0e59c-4cfe-4dd0-83db-815661ee958c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759a6293-e0d2-4204-81b0-0563d535bb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:35 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Volume c0904148-7831-47da-a37b-ddce51943ed5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0904148-7831-47da-a37b-ddce51943ed5', 'volume_size': 1}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6a2b60f0-e30a-4655-abf1-14ae326fc42e,created_at=2026-06-05T23:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1862496903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6a2b60f0-e30a-4655-abf1-14ae326fc42e,host='devstack@QuobyteHD#QuobyteHD',id=c0904148-7831-47da-a37b-ddce51943ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3486bade41c040ca8681beffa0676c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:13:36Z,use_quota=True,user_id='5a4b8e90217f4714a9c4c32c889c82ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97633f63-4c1a-410b-99d9-5f9a5f4ec610),volume_type_id=97633f63-4c1a-410b-99d9-5f9a5f4ec610)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Creating volume c0904148-7831-47da-a37b-ddce51943ed5 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:13:35 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:13:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:35 devstack sudo[98715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5 1073741824
Jun 06 01:13:35 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:36 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5 1073741824" returned: 0 in 0.769s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:36 devstack sudo[98720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5
Jun 06 01:13:36 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-6d80bb35-6ddc-477c-9ce7-225c80f70121 req-f7afa967-0732-4619-b9e4-8d8b6cf7e902 tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:37 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5" returned: 0 in 0.602s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:13:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-6d80bb35-6ddc-477c-9ce7-225c80f70121 req-f7afa967-0732-4619-b9e4-8d8b6cf7e902 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.230s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759a6293-e0d2-4204-81b0-0563d535bb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0904148-7831-47da-a37b-ddce51943ed5', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e2d70b-8f10-459a-99e7-d0fe3d4cfae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:13:37 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[2011c762-e8b1-4ce5-9dcd-e652e758d750]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-6d80bb35-6ddc-477c-9ce7-225c80f70121 req-f7afa967-0732-4619-b9e4-8d8b6cf7e902 tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:37 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Volume volume-c0904148-7831-47da-a37b-ddce51943ed5 (c0904148-7831-47da-a37b-ddce51943ed5): created successfully
Jun 06 01:13:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e2d70b-8f10-459a-99e7-d0fe3d4cfae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:13:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Flow 'volume_create_manager' (49861904-5b66-4cea-961a-c6e9d14af781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:13:37 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-0d99b527-ed2d-4b7b-bb04-536a73f4c476 tempest-GroupSnapshotsTest-1783584790 None] Created volume successfully.
Jun 06 01:13:37 devstack sudo[98731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7
Jun 06 01:13:37 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:37 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-6d80bb35-6ddc-477c-9ce7-225c80f70121 req-f7afa967-0732-4619-b9e4-8d8b6cf7e902 tempest-AttachVolumeNegativeTest-1679390173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7" returned: 0 in 0.734s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-6d80bb35-6ddc-477c-9ce7-225c80f70121 req-f7afa967-0732-4619-b9e4-8d8b6cf7e902 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.764s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:37 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=155,cinder:SELECT=126,cinder:INSERT=33,cinder:DELETE=9 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:13:37 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=118,cinder:UPDATE=146,cinder:DELETE=14,cinder:INSERT=36 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:13:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-6d80bb35-6ddc-477c-9ce7-225c80f70121 req-f7afa967-0732-4619-b9e4-8d8b6cf7e902 tempest-AttachVolumeNegativeTest-1679390173 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ad61a15-55a8-4021-88dc-1f70016134b1', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:13:37 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-6d80bb35-6ddc-477c-9ce7-225c80f70121 req-f7afa967-0732-4619-b9e4-8d8b6cf7e902 tempest-AttachVolumeNegativeTest-1679390173 None] attachment_update completed successfully.
Jun 06 01:13:37 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-5f66aa4f-1854-47ba-9c30-e82028b29083 tempest-GroupSnapshotsTest-1783584790 None] Update group completed successfully.
Jun 06 01:13:39 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-039c642a-5549-4235-978b-7003a1033e81 tempest-GroupSnapshotsTest-1783584790 None] Update group completed successfully.
Jun 06 01:13:40 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c30f3caa-cc0a-479d-9e12-69d063ec9db2 tempest-GroupSnapshotsTest-1783584790 None] Update group completed successfully.
Jun 06 01:13:41 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-aee8dff0-59bf-4502-a617-da05a9612aa2 tempest-GroupSnapshotsTest-1783584790 None] Update group completed successfully.
Jun 06 01:13:42 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] GroupSnapshot 081e6be7-af5b-431d-a374-b873f0e98019: creating.
Jun 06 01:13:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Group snapshot 081e6be7-af5b-431d-a374-b873f0e98019: creating. {{(pid=86581) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 06 01:13:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:42 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Creating offline snapshot 040af6d9-7268-4e4f-8fbe-4e5d582d3900 of volume c0904148-7831-47da-a37b-ddce51943ed5 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:13:42 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00c414e-3291-480a-b480-c1cbffb3a8a0]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:42 devstack sudo[99119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5
Jun 06 01:13:42 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:43 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5" returned: 0 in 0.725s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:43 devstack sudo[99125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900 1G
Jun 06 01:13:43 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:43 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-cceaf34a-dc6e-40ba-ad20-69fa0eb29c5f req-e803e974-cf9c-4672-8489-1682dd7993bb tempest-AttachVolumeNegativeTest-1679390173 None] Terminate volume connection completed successfully.
Jun 06 01:13:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-cceaf34a-dc6e-40ba-ad20-69fa0eb29c5f req-e803e974-cf9c-4672-8489-1682dd7993bb tempest-AttachVolumeNegativeTest-1679390173 None] Deleting attachment 9ad61a15-55a8-4021-88dc-1f70016134b1. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:13:44 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900 1G" returned: 0 in 0.751s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0904148-7831-47da-a37b-ddce51943ed5 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:44 devstack sudo[99165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0904148-7831-47da-a37b-ddce51943ed5 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900
Jun 06 01:13:44 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:44 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0904148-7831-47da-a37b-ddce51943ed5 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900" returned: 0 in 0.640s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:44 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900 is being set with open permissions: ugo+rw: NotImplementedError
Jun 06 01:13:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:44 devstack sudo[99170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900
Jun 06 01:13:44 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:45 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900" returned: 0 in 0.594s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:45 devstack sudo[99173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.info
Jun 06 01:13:45 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:46 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.info" returned: 0 in 0.641s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:46 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 06 01:13:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:46 devstack sudo[99176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.info
Jun 06 01:13:46 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:46 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.info" returned: 0 in 0.596s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.023s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Creating offline snapshot ab2affbc-390e-4579-861b-5826520bd86f of volume 659746bf-34b8-4904-b02a-16d0eea29a63 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:13:46 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45020d2-2ea7-469d-8426-22d2e3911487]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:47 devstack sudo[99179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63
Jun 06 01:13:47 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:47 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63" returned: 0 in 0.859s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:47 devstack sudo[99224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f 1G
Jun 06 01:13:47 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:48 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f 1G" returned: 0 in 0.799s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-659746bf-34b8-4904-b02a-16d0eea29a63 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:48 devstack sudo[99232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-659746bf-34b8-4904-b02a-16d0eea29a63 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f
Jun 06 01:13:48 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:49 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-659746bf-34b8-4904-b02a-16d0eea29a63 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f" returned: 0 in 0.677s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:49 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f is being set with open permissions: ugo+rw: NotImplementedError
Jun 06 01:13:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:49 devstack sudo[99240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f
Jun 06 01:13:49 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:49 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f" returned: 0 in 0.624s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:49 devstack sudo[99243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.info
Jun 06 01:13:49 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:50 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.info" returned: 0 in 0.590s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:50 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 06 01:13:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:50 devstack sudo[99246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.info
Jun 06 01:13:50 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:50 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.info" returned: 0 in 0.589s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.220s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:51 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c31316ba-b115-45d8-b9e6-ec593a646140 tempest-GroupSnapshotsTest-1783584790 None] group_snapshot 081e6be7-af5b-431d-a374-b873f0e98019: created successfully
Jun 06 01:13:52 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] group_snapshot 081e6be7-af5b-431d-a374-b873f0e98019: deleting
Jun 06 01:13:52 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] group_snapshot 081e6be7-af5b-431d-a374-b873f0e98019: deleting {{(pid=86581) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 06 01:13:52 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "cinder-quobyte-c0904148-7831-47da-a37b-ddce51943ed5" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:52 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-c0904148-7831-47da-a37b-ddce51943ed5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:52 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "cinder-quobyte-040af6d9-7268-4e4f-8fbe-4e5d582d3900" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:52 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-040af6d9-7268-4e4f-8fbe-4e5d582d3900" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:52 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Deleting offline snapshot 040af6d9-7268-4e4f-8fbe-4e5d582d3900 of volume c0904148-7831-47da-a37b-ddce51943ed5 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:13:52 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] snapshot_file for this snap is: volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:13:52 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc487af9-0e01-4c00-9b16-c3c82b31dca6]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:52 devstack sudo[99249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900
Jun 06 01:13:52 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:53 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900" returned: 0 in 0.693s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0904148-7831-47da-a37b-ddce51943ed5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:13:53 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e1174e-f2c6-447f-8ee7-60cfd55b6391]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:53 devstack sudo[99255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5
Jun 06 01:13:53 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:53 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5" returned: 0 in 0.764s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:53 devstack sudo[99260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900
Jun 06 01:13:53 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "cinder-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] Lock "cinder-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "cinder-quobyte-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] Lock "cinder-quobyte-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7" acquired by "delete_volume" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:54 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c0a5df-44a9-4def-9a7a-3e6b8c3051a4]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:54 devstack sudo[99262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7
Jun 06 01:13:54 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:54 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900" returned: 0 in 0.678s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:54 devstack sudo[99267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900
Jun 06 01:13:54 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:54 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7" returned: 0 in 0.757s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:54 devstack sudo[99272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7
Jun 06 01:13:54 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:55 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5.040af6d9-7268-4e4f-8fbe-4e5d582d3900" returned: 0 in 0.597s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-040af6d9-7268-4e4f-8fbe-4e5d582d3900" released by "_delete_snapshot" :: held 2.835s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-c0904148-7831-47da-a37b-ddce51943ed5" released by "delete_snapshot" :: held 2.855s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "cinder-quobyte-659746bf-34b8-4904-b02a-16d0eea29a63" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-659746bf-34b8-4904-b02a-16d0eea29a63" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "cinder-quobyte-ab2affbc-390e-4579-861b-5826520bd86f" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-ab2affbc-390e-4579-861b-5826520bd86f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Deleting offline snapshot ab2affbc-390e-4579-861b-5826520bd86f of volume 659746bf-34b8-4904-b02a-16d0eea29a63 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] snapshot_file for this snap is: volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c9bfb3-82f2-4d1a-b98d-496660ba6754]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:55 devstack sudo[99275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f
Jun 06 01:13:55 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:55 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7" returned: 0 in 0.622s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] Lock "cinder-quobyte-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7" released by "delete_volume" :: held 1.433s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] Created reservations ['1a5ecdc3-9051-4487-b28b-1baab15dd7c7', '0054e873-87c3-4216-aa8b-b92aed560d76', '12b0250b-ba30-4170-b627-488a24d0678a', '27e17e9b-5f0e-4f83-8d69-74a6d3ebacd9'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:55 devstack sudo[99278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:13:55 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:55 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f" returned: 0 in 0.710s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-659746bf-34b8-4904-b02a-16d0eea29a63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:13:56 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e437ddc-d26f-4444-94f4-10302114bde8]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:56 devstack sudo[99284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63
Jun 06 01:13:56 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:56 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.611s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:56 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:13:56 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] Deleted volume successfully.
Jun 06 01:13:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7524392d-9436-4118-be82-ec7a5bc1276e tempest-AttachVolumeNegativeTest-1679390173 None] Lock "cinder-ef9f858b-14e7-42ac-b221-e7fdd8dbabe7-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "cinder-e9ca450d-78d5-46fc-8589-02ab69314fee-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "cinder-e9ca450d-78d5-46fc-8589-02ab69314fee-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "cinder-quobyte-e9ca450d-78d5-46fc-8589-02ab69314fee" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "cinder-quobyte-e9ca450d-78d5-46fc-8589-02ab69314fee" acquired by "delete_volume" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:56 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb92eb59-6280-4156-821c-d2027d7e7a36]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e9ca450d-78d5-46fc-8589-02ab69314fee {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:56 devstack sudo[99287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e9ca450d-78d5-46fc-8589-02ab69314fee
Jun 06 01:13:56 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:56 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63" returned: 0 in 0.745s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:56 devstack sudo[99292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f
Jun 06 01:13:56 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:57 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e9ca450d-78d5-46fc-8589-02ab69314fee" returned: 0 in 0.719s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e9ca450d-78d5-46fc-8589-02ab69314fee {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:57 devstack sudo[99297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e9ca450d-78d5-46fc-8589-02ab69314fee
Jun 06 01:13:57 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:57 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f" returned: 0 in 0.690s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:57 devstack sudo[99302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f
Jun 06 01:13:57 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:57 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e9ca450d-78d5-46fc-8589-02ab69314fee" returned: 0 in 0.608s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "cinder-quobyte-e9ca450d-78d5-46fc-8589-02ab69314fee" released by "delete_volume" :: held 1.366s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:57 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] Created reservations ['1fcb9bab-7642-4546-b8fb-a9726cc9734f', '41d21a59-0b32-43bd-be28-f81d2e4ac68b', '419a3e13-7cc9-41d8-aa86-1efb9c58951b', 'fe97bfb0-2aa4-4862-82d8-f415911c9bbf'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:13:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:13:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:13:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:57 devstack sudo[99305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:13:57 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:58 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63.ab2affbc-390e-4579-861b-5826520bd86f" returned: 0 in 0.588s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-ab2affbc-390e-4579-861b-5826520bd86f" released by "_delete_snapshot" :: held 2.819s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-659746bf-34b8-4904-b02a-16d0eea29a63" released by "delete_snapshot" :: held 2.843s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:58 devstack cinder-volume[86581]: WARNING cinder.quota [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1252070997 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1252070997, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:13:58 devstack cinder-volume[86581]: WARNING cinder.quota [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1252070997 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1252070997, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:13:58 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Created reservations ['0041f9de-e4a7-4295-b0e3-3ea5c2840cf5', 'c736ea3b-6ed2-45db-a379-5da76316328c', 'dc5b1298-3090-4ba8-8392-8e13f0399aa2', 'f07e0d21-a751-4582-9be8-eb0ef9acb2b4'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:13:58 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] Created reservations ['298b17d6-e85d-4430-964a-793707ba8e89', '60106e3b-ee72-4866-bc96-8bd5b846aa1a', 'ea69e0a7-3c9d-4a40-8e71-9f18f9f66236', '4bd7105f-55d6-4593-aa71-4f270c8e1810'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:13:58 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f3f8f236-ebfd-48ff-a093-c84cc2f97d3b tempest-GroupSnapshotsTest-1783584790 None] group_snapshot 081e6be7-af5b-431d-a374-b873f0e98019: deleted successfully
Jun 06 01:13:58 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.587s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:58 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:13:58 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] Deleted volume successfully.
Jun 06 01:13:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-41944390-9bef-4c59-ba33-2aa1c9c19855 tempest-AttachVolumeNegativeTest-1679390173 None] Lock "cinder-e9ca450d-78d5-46fc-8589-02ab69314fee-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:13:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "cinder-9094056f-5dd1-454e-a99a-2f446406dfa7-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] Lock "cinder-9094056f-5dd1-454e-a99a-2f446406dfa7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "cinder-quobyte-9094056f-5dd1-454e-a99a-2f446406dfa7" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] Lock "cinder-quobyte-9094056f-5dd1-454e-a99a-2f446406dfa7" acquired by "delete_volume" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:58 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[027d1682-6dc8-4d40-9d98-043ce7484725]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9094056f-5dd1-454e-a99a-2f446406dfa7 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:58 devstack sudo[99309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9094056f-5dd1-454e-a99a-2f446406dfa7
Jun 06 01:13:58 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "cinder-quobyte-659746bf-34b8-4904-b02a-16d0eea29a63" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:13:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-659746bf-34b8-4904-b02a-16d0eea29a63" acquired by "delete_volume" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:13:59 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2293cc-e699-45f7-bb16-8db75664fc05]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:13:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:59 devstack sudo[99311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63
Jun 06 01:13:59 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:13:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:13:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:13:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:13:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:13:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:13:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:59 devstack sudo[99314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:13:59 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:59 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9094056f-5dd1-454e-a99a-2f446406dfa7" returned: 0 in 0.739s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9094056f-5dd1-454e-a99a-2f446406dfa7 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:59 devstack sudo[99318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9094056f-5dd1-454e-a99a-2f446406dfa7
Jun 06 01:13:59 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:59 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63" returned: 0 in 0.752s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:13:59 devstack sudo[99323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63
Jun 06 01:13:59 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:13:59 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root
Jun 06 01:13:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.634s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:13:59 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:14:00 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-9094056f-5dd1-454e-a99a-2f446406dfa7" returned: 0 in 0.639s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] Lock "cinder-quobyte-9094056f-5dd1-454e-a99a-2f446406dfa7" released by "delete_volume" :: held 1.435s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] Created reservations ['c2806226-b69c-4863-9078-fc6ffd749e0f', 'bc748869-4b64-4e2a-91c4-444f86f86640', '3e244c21-53a3-413b-afbc-e29d2cccc967', 'f56b5029-3b7c-47d6-b305-f73a75aa4987'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:00 devstack sudo[99327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:14:00 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:00 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-659746bf-34b8-4904-b02a-16d0eea29a63" returned: 0 in 0.601s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-659746bf-34b8-4904-b02a-16d0eea29a63" released by "delete_volume" :: held 1.426s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "cinder-quobyte-c0904148-7831-47da-a37b-ddce51943ed5" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-c0904148-7831-47da-a37b-ddce51943ed5" acquired by "delete_volume" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb0becf-7ab5-4631-bc3b-c3b02389b7d5]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:00 devstack sudo[99330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5
Jun 06 01:14:00 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:00 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.651s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:14:00 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] Deleted volume successfully.
Jun 06 01:14:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8727542f-1cee-4af9-91f9-82ed7d27cb1b tempest-AttachVolumeNegativeTest-1679390173 None] Lock "cinder-9094056f-5dd1-454e-a99a-2f446406dfa7-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:01 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5" returned: 0 in 0.789s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:01 devstack sudo[99337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5
Jun 06 01:14:01 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:01 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-c0904148-7831-47da-a37b-ddce51943ed5" returned: 0 in 0.605s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-c0904148-7831-47da-a37b-ddce51943ed5" released by "delete_volume" :: held 1.456s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:01 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Created reservations ['97e0d614-6f84-4c77-8bce-dbd65c40f4ed'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:02 devstack cinder-volume[86581]: WARNING cinder.quota [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1252070997 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1252070997, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:14:02 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Created reservations ['db61d895-5378-4ea4-93d2-452c9d0b3684', 'bc3c6c1b-da07-4406-b41e-4e3836ed6f2e', '4fe9112b-51e0-4bb2-9d9d-32466c923cda', '56443792-ca3b-4746-a029-c07cf886b790'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:02 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Created reservations ['f842d1f5-3c23-4f54-b14b-0dbaf8ccf158', 'bf96318e-e46b-4c71-adff-074ef2553a98', 'dafd1ef7-69d5-47a2-abc0-99e2d1e4b1da', '9633d1b9-a839-4157-b633-950542880a07'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:02 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:02 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:02 devstack sudo[99340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:14:02 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:02 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d420ca82-3a68-41eb-ae74-616f36370351 tempest-GroupSnapshotsTest-1783584790 None] Group tempest-GroupSnapshotsTest-Group-223999480: creating
Jun 06 01:14:02 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d420ca82-3a68-41eb-ae74-616f36370351 tempest-GroupSnapshotsTest-1783584790 None] Group tempest-GroupSnapshotsTest-Group-223999480: created successfully
Jun 06 01:14:02 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d420ca82-3a68-41eb-ae74-616f36370351 tempest-GroupSnapshotsTest-1783584790 None] Create group completed successfully.
Jun 06 01:14:02 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.643s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:02 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:14:02 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-08562e51-8594-4ac0-b54c-b0b39d94744a tempest-GroupSnapshotsTest-1783584790 None] Delete group completed successfully.
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Flow 'volume_create_manager' (6dce072f-3e7d-49c9-8c16-11d918cdf546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51219e9d-e277-4228-a05e-9de3ea459800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51219e9d-e277-4228-a05e-9de3ea459800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1672877467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4135666f-fb94-453e-a364-81887615cdec,host='devstack@QuobyteHD#QuobyteHD',id=f2454436-d14d-462c-928f-d72e091b7322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3486bade41c040ca8681beffa0676c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:04Z,use_quota=True,user_id='5a4b8e90217f4714a9c4c32c889c82ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72c77abf-330f-43e5-a676-5fcbf5ce5d58),volume_type_id=72c77abf-330f-43e5-a676-5fcbf5ce5d58)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec893d49-0459-4ce4-ae15-d929111b1ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec893d49-0459-4ce4-ae15-d929111b1ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7308c06-74d2-4782-acd6-0529b09e1e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7308c06-74d2-4782-acd6-0529b09e1e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2454436-d14d-462c-928f-d72e091b7322', 'volume_name': 'volume-f2454436-d14d-462c-928f-d72e091b7322', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4daa7f2e-8ed4-48b7-a17f-f7dacf5974bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4daa7f2e-8ed4-48b7-a17f-f7dacf5974bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d681f5a9-cd7d-45b9-92c7-843131c78c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:04 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Volume f2454436-d14d-462c-928f-d72e091b7322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2454436-d14d-462c-928f-d72e091b7322', 'volume_size': 1}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4135666f-fb94-453e-a364-81887615cdec,created_at=2026-06-05T23:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1672877467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4135666f-fb94-453e-a364-81887615cdec,host='devstack@QuobyteHD#QuobyteHD',id=f2454436-d14d-462c-928f-d72e091b7322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3486bade41c040ca8681beffa0676c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:04Z,use_quota=True,user_id='5a4b8e90217f4714a9c4c32c889c82ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72c77abf-330f-43e5-a676-5fcbf5ce5d58),volume_type_id=72c77abf-330f-43e5-a676-5fcbf5ce5d58)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Creating volume f2454436-d14d-462c-928f-d72e091b7322 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:14:04 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:14:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:04 devstack sudo[99345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322 1073741824
Jun 06 01:14:04 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:05 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322 1073741824" returned: 0 in 0.857s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:05 devstack sudo[99352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322
Jun 06 01:14:05 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:05 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322" returned: 0 in 0.626s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:14:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d681f5a9-cd7d-45b9-92c7-843131c78c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2454436-d14d-462c-928f-d72e091b7322', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524e4f9f-bd77-4750-8993-dbd0c856c617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:05 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Volume volume-f2454436-d14d-462c-928f-d72e091b7322 (f2454436-d14d-462c-928f-d72e091b7322): created successfully
Jun 06 01:14:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524e4f9f-bd77-4750-8993-dbd0c856c617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Flow 'volume_create_manager' (6dce072f-3e7d-49c9-8c16-11d918cdf546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:05 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-7270a8f3-e4e2-4436-a2f7-50c7944598af tempest-GroupSnapshotsTest-1783584790 None] Created volume successfully.
Jun 06 01:14:06 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] GroupSnapshot 64d87eb7-749c-4a61-8e42-4e1a62118bf1: creating.
Jun 06 01:14:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] Group snapshot 64d87eb7-749c-4a61-8e42-4e1a62118bf1: creating. {{(pid=86581) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 06 01:14:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] Creating offline snapshot 1ffa29a2-e1e8-48c2-9f3a-455d87e30201 of volume f2454436-d14d-462c-928f-d72e091b7322 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:14:06 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf53f3d3-ff20-4215-8b9f-f3272594002f]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:06 devstack sudo[99355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322
Jun 06 01:14:06 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:07 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322" returned: 0 in 0.725s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:07 devstack sudo[99360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201 1G
Jun 06 01:14:07 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:07 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:14:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Flow 'volume_create_manager' (79db4ecf-74de-44ed-b196-9e29e1466031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37265dfe-fd17-41ee-8276-f0cbdd586a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37265dfe-fd17-41ee-8276-f0cbdd586a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1465341039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2de2850-dcf6-45a1-87ac-4775e434a5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3bbe17e76e949a3971bbe428deee396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:08Z,use_quota=True,user_id='d897559ae110434a89cc137e36e0e326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a693f49b-9f3d-4696-8f9f-2356553412c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a693f49b-9f3d-4696-8f9f-2356553412c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770f886f-4654-4d0d-8748-14091100b5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770f886f-4654-4d0d-8748-14091100b5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2de2850-dcf6-45a1-87ac-4775e434a5c5', 'volume_name': 'volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef9f555-70e0-4d1f-bef2-d97146473c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef9f555-70e0-4d1f-bef2-d97146473c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e0c483-8832-4124-a37b-f7cb2747d818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:07 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Volume a2de2850-dcf6-45a1-87ac-4775e434a5c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5', 'volume_size': 1}
Jun 06 01:14:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:08 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201 1G" returned: 0 in 0.745s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2454436-d14d-462c-928f-d72e091b7322 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:08 devstack sudo[99365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2454436-d14d-462c-928f-d72e091b7322 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201
Jun 06 01:14:08 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:08 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2454436-d14d-462c-928f-d72e091b7322 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201" returned: 0 in 0.632s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:08 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201 is being set with open permissions: ugo+rw: NotImplementedError
Jun 06 01:14:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:08 devstack sudo[99370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201
Jun 06 01:14:08 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:09 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201" returned: 0 in 0.572s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:09 devstack sudo[99373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.info
Jun 06 01:14:09 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:10 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.info" returned: 0 in 0.595s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:10 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 06 01:14:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:10 devstack sudo[99376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.info
Jun 06 01:14:10 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:10 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.info" returned: 0 in 0.592s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.937s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.786s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1465341039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2de2850-dcf6-45a1-87ac-4775e434a5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3bbe17e76e949a3971bbe428deee396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:08Z,use_quota=True,user_id='d897559ae110434a89cc137e36e0e326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:14:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Creating volume a2de2850-dcf6-45a1-87ac-4775e434a5c5 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:14:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:14:10 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:14:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:10 devstack sudo[99379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5 1073741824
Jun 06 01:14:10 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:10 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-330f24c7-1d80-4e0b-90d3-8b526089d9a6 tempest-GroupSnapshotsTest-1783584790 None] group_snapshot 64d87eb7-749c-4a61-8e42-4e1a62118bf1: created successfully
Jun 06 01:14:11 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] group_snapshot 64d87eb7-749c-4a61-8e42-4e1a62118bf1: deleting
Jun 06 01:14:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] group_snapshot 64d87eb7-749c-4a61-8e42-4e1a62118bf1: deleting {{(pid=86581) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 06 01:14:11 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "cinder-quobyte-f2454436-d14d-462c-928f-d72e091b7322" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:11 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-f2454436-d14d-462c-928f-d72e091b7322" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:11 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "cinder-quobyte-1ffa29a2-e1e8-48c2-9f3a-455d87e30201" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:11 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-1ffa29a2-e1e8-48c2-9f3a-455d87e30201" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] Deleting offline snapshot 1ffa29a2-e1e8-48c2-9f3a-455d87e30201 of volume f2454436-d14d-462c-928f-d72e091b7322 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:14:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] snapshot_file for this snap is: volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:14:11 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5af76b-1e92-4530-9c11-ff0e778809f7]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:11 devstack sudo[99383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201
Jun 06 01:14:11 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:11 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5 1073741824" returned: 0 in 0.807s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:11 devstack sudo[99386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5
Jun 06 01:14:11 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:11 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201" returned: 0 in 0.748s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2454436-d14d-462c-928f-d72e091b7322(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:14:11 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[080eec2c-f604-4059-b662-9a0db81fc45e]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:12 devstack sudo[99428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322
Jun 06 01:14:12 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:12 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5" returned: 0 in 0.622s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:14:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e0c483-8832-4124-a37b-f7cb2747d818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5d97b5-e546-4980-a67c-ea5e1e67233c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:12 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Volume volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5 (a2de2850-dcf6-45a1-87ac-4775e434a5c5): created successfully
Jun 06 01:14:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5d97b5-e546-4980-a67c-ea5e1e67233c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Flow 'volume_create_manager' (79db4ecf-74de-44ed-b196-9e29e1466031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:12 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-3b6094f4-bf62-4a7d-b7fc-1af423a85fe4 req-93be4b87-3578-4095-b4f3-775b3867dd0d tempest-VolumesSnapshotsTestJSON-1527488810 None] Created volume successfully.
Jun 06 01:14:12 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322" returned: 0 in 0.692s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:12 devstack sudo[99434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201
Jun 06 01:14:12 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:13 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201" returned: 0 in 0.688s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:13 devstack sudo[99440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201
Jun 06 01:14:13 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] Creating offline snapshot 655d2f8b-2f8d-49e6-b92f-1d31511f6028 of volume a2de2850-dcf6-45a1-87ac-4775e434a5c5 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:14:13 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce0ecee-e88c-4d51-a178-87df09063689]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:13 devstack sudo[99442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5
Jun 06 01:14:13 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:13 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322.1ffa29a2-e1e8-48c2-9f3a-455d87e30201" returned: 0 in 0.618s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-1ffa29a2-e1e8-48c2-9f3a-455d87e30201" released by "_delete_snapshot" :: held 2.859s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-f2454436-d14d-462c-928f-d72e091b7322" released by "delete_snapshot" :: held 2.884s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:14 devstack cinder-volume[86581]: WARNING cinder.quota [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-531249357 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-531249357, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:14:14 devstack cinder-volume[86581]: WARNING cinder.quota [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-531249357 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-531249357, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:14:14 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] Created reservations ['cc97835d-72d6-4a0d-9a39-234be0abbf33', '2336a912-47a5-41a6-b3df-a5c756618c02', '0897f39f-28b7-4fa2-a582-48c177840cf6', 'ed349722-d31c-45de-8f45-233a3b186d68'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:14 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-af63668b-1bc7-49ed-aa53-13d8a241db69 tempest-GroupSnapshotsTest-1783584790 None] group_snapshot 64d87eb7-749c-4a61-8e42-4e1a62118bf1: deleted successfully
Jun 06 01:14:14 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5" returned: 0 in 0.733s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:14 devstack sudo[99448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028 1G
Jun 06 01:14:14 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "cinder-quobyte-f2454436-d14d-462c-928f-d72e091b7322" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-f2454436-d14d-462c-928f-d72e091b7322" acquired by "delete_volume" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:14 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[f825a3f3-cc25-4985-a9be-1e915f786155]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:14 devstack sudo[99450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322
Jun 06 01:14:14 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:14 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028 1G" returned: 0 in 0.763s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:15 devstack sudo[99455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028
Jun 06 01:14:15 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:15 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322" returned: 0 in 0.710s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:15 devstack sudo[99460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322
Jun 06 01:14:15 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:15 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028" returned: 0 in 0.631s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:15 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028 is being set with open permissions: ugo+rw
Jun 06 01:14:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:15 devstack sudo[99465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028
Jun 06 01:14:15 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:15 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f2454436-d14d-462c-928f-d72e091b7322" returned: 0 in 0.593s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] Lock "cinder-quobyte-f2454436-d14d-462c-928f-d72e091b7322" released by "delete_volume" :: held 1.383s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:16 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] Created reservations ['ce0d1b25-6185-4504-a3db-e71673e2a4d8'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:16 devstack cinder-volume[86581]: WARNING cinder.quota [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-531249357 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-531249357, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:14:16 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] Created reservations ['ac633614-9bb0-4b07-9cff-d27eda358944', 'f4d2a74e-933c-44d0-83c0-11ac22ba7f8c', '93cc15e7-6f23-478e-96d9-f12f745262e8', 'f87e93bd-40bd-4893-aae4-43a02d0ea4e5'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:16 devstack sudo[99469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:14:16 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:16 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028" returned: 0 in 0.610s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:16 devstack sudo[99471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.info
Jun 06 01:14:16 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:16 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.619s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:16 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:14:16 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b75ca0d3-8f64-4413-a0c1-0266d9f83db8 tempest-GroupSnapshotsTest-1783584790 None] Delete group completed successfully.
Jun 06 01:14:16 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.info" returned: 0 in 0.612s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:16 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.info is being set with open permissions: ugo+rw
Jun 06 01:14:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:16 devstack sudo[99481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.info
Jun 06 01:14:16 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:17 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.info" returned: 0 in 0.603s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.037s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:17 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-4cfaef03-b123-47cd-9eae-168ec239de44 req-77d64872-82f9-4997-a732-d009c94ba6dd tempest-VolumesSnapshotsTestJSON-1527488810 None] Create snapshot completed successfully
Jun 06 01:14:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] Acquiring lock "cinder-655d2f8b-2f8d-49e6-b92f-1d31511f6028-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "cinder-655d2f8b-2f8d-49e6-b92f-1d31511f6028-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] Acquiring lock "cinder-quobyte-a2de2850-dcf6-45a1-87ac-4775e434a5c5" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "cinder-quobyte-a2de2850-dcf6-45a1-87ac-4775e434a5c5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] Acquiring lock "cinder-quobyte-655d2f8b-2f8d-49e6-b92f-1d31511f6028" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "cinder-quobyte-655d2f8b-2f8d-49e6-b92f-1d31511f6028" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] Deleting offline snapshot 655d2f8b-2f8d-49e6-b92f-1d31511f6028 of volume a2de2850-dcf6-45a1-87ac-4775e434a5c5 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:14:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] snapshot_file for this snap is: volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:14:18 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c67307-1cf5-4ff9-ba5f-d2e53e6ad257]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:18 devstack sudo[99484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028
Jun 06 01:14:18 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:18 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028" returned: 0 in 0.737s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:18 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:14:18 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b8cae5-f604-4749-bc09-77a3238f0dde]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:18 devstack sudo[99490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5
Jun 06 01:14:18 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:19 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5" returned: 0 in 0.731s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:19 devstack sudo[99495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028
Jun 06 01:14:19 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:20 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028" returned: 0 in 0.724s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:20 devstack sudo[99500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028
Jun 06 01:14:20 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:20 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5.655d2f8b-2f8d-49e6-b92f-1d31511f6028" returned: 0 in 0.612s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "cinder-quobyte-655d2f8b-2f8d-49e6-b92f-1d31511f6028" released by "_delete_snapshot" :: held 2.919s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "cinder-quobyte-a2de2850-dcf6-45a1-87ac-4775e434a5c5" released by "delete_snapshot" :: held 2.950s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:20 devstack cinder-volume[86581]: DEBUG cinder.quota [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] Created reservations ['db462d13-6f03-4c47-9c60-1c98dfde4da5', '4ce51088-5033-4a3e-9010-2734790ae3a7', '1459d5a2-4e0c-4497-953c-aefa181fc05c', 'bc6dfd2b-5d26-4981-8cc7-6011f65709b0'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:21 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] Delete snapshot completed successfully.
Jun 06 01:14:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-023e7f2c-8c7d-41f4-83e4-3cf48a1b6945 req-dbd18a6c-31e8-4787-9d36-0b81577f3d32 tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "cinder-655d2f8b-2f8d-49e6-b92f-1d31511f6028-delete_snapshot" released by "delete_snapshot" :: held 3.077s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] Acquiring lock "cinder-a2de2850-dcf6-45a1-87ac-4775e434a5c5-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "cinder-a2de2850-dcf6-45a1-87ac-4775e434a5c5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] Acquiring lock "cinder-quobyte-a2de2850-dcf6-45a1-87ac-4775e434a5c5" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "cinder-quobyte-a2de2850-dcf6-45a1-87ac-4775e434a5c5" acquired by "delete_volume" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:21 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5aa057c-e746-4c5e-a3d1-69dbe465628b]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:21 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-8b892be6-1541-40d4-96e6-d6be2ff31015 tempest-GroupsTest-1217041605 None] Group tempest-Group1-758047296: creating
Jun 06 01:14:21 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-8b892be6-1541-40d4-96e6-d6be2ff31015 tempest-GroupsTest-1217041605 None] Group tempest-Group1-758047296: created successfully
Jun 06 01:14:21 devstack sudo[99503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5
Jun 06 01:14:21 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-8b892be6-1541-40d4-96e6-d6be2ff31015 tempest-GroupsTest-1217041605 None] Create group completed successfully.
Jun 06 01:14:21 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:22 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5" returned: 0 in 0.703s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:22 devstack sudo[99508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5
Jun 06 01:14:22 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:22 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a2de2850-dcf6-45a1-87ac-4775e434a5c5" returned: 0 in 0.582s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "cinder-quobyte-a2de2850-dcf6-45a1-87ac-4775e434a5c5" released by "delete_volume" :: held 1.365s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:22 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-fecdff7a-b4fb-4c3d-96df-69f95f020bbe tempest-GroupsTest-1217041605 None] Group tempest-Group2-1555009595: creating
Jun 06 01:14:22 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-fecdff7a-b4fb-4c3d-96df-69f95f020bbe tempest-GroupsTest-1217041605 None] Group tempest-Group2-1555009595: created successfully
Jun 06 01:14:22 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-fecdff7a-b4fb-4c3d-96df-69f95f020bbe tempest-GroupsTest-1217041605 None] Create group completed successfully.
Jun 06 01:14:22 devstack cinder-volume[86581]: DEBUG cinder.quota [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] Created reservations ['3c54288b-25d4-477a-b1fe-9e1fcc86ad15', 'cff80c0d-5d05-49f3-9c85-b38c1b3c45fc', 'fe640dd7-e2f1-40ce-ac69-6ff0234752aa', 'ed7e9726-e94f-4c98-acf1-ca20a23301fa'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:22 devstack sudo[99511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:14:22 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:23 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.582s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:23 devstack cinder-volume[86581]: DEBUG cinder.manager [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:14:23 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] Deleted volume successfully.
Jun 06 01:14:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-4f5e8365-cca6-47dd-b6c6-01ff077e20fd req-d2aa0831-ed32-4057-b0c1-5230721cb090 tempest-VolumesSnapshotsTestJSON-1527488810 None] Lock "cinder-a2de2850-dcf6-45a1-87ac-4775e434a5c5-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Flow 'volume_create_manager' (85f3a588-7020-4bbf-97c0-ebb49d3d7162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc14126-bc24-4c87-b41c-e10806eadcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc14126-bc24-4c87-b41c-e10806eadcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-323118652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d4add399-e014-47ea-a331-8a588c016887,host='devstack@QuobyteHD#QuobyteHD',id=b68e8ba4-713c-4853-b6f6-56a44826d22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadd26a022224f3cb00d4b30c9b3fb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:24Z,use_quota=True,user_id='8c868e6260a34f419c72481c2768d9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ca4c779-4a8c-456d-a96b-6572adacc27f),volume_type_id=8ca4c779-4a8c-456d-a96b-6572adacc27f)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3633da82-1394-4f5d-96f8-5833ca626d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3633da82-1394-4f5d-96f8-5833ca626d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80d7d7f-7c90-4b8d-9669-5345f523944c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80d7d7f-7c90-4b8d-9669-5345f523944c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b68e8ba4-713c-4853-b6f6-56a44826d22a', 'volume_name': 'volume-b68e8ba4-713c-4853-b6f6-56a44826d22a', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e90483f-e2ce-4b09-82dc-9507d6db7642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e90483f-e2ce-4b09-82dc-9507d6db7642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3e4d89-d7c4-4556-bdd2-e1d093add70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:24 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Volume b68e8ba4-713c-4853-b6f6-56a44826d22a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b68e8ba4-713c-4853-b6f6-56a44826d22a', 'volume_size': 1}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d4add399-e014-47ea-a331-8a588c016887,created_at=2026-06-05T23:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-323118652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d4add399-e014-47ea-a331-8a588c016887,host='devstack@QuobyteHD#QuobyteHD',id=b68e8ba4-713c-4853-b6f6-56a44826d22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadd26a022224f3cb00d4b30c9b3fb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:24Z,use_quota=True,user_id='8c868e6260a34f419c72481c2768d9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ca4c779-4a8c-456d-a96b-6572adacc27f),volume_type_id=8ca4c779-4a8c-456d-a96b-6572adacc27f)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Creating volume b68e8ba4-713c-4853-b6f6-56a44826d22a {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:14:24 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:14:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b68e8ba4-713c-4853-b6f6-56a44826d22a 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:24 devstack sudo[99516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b68e8ba4-713c-4853-b6f6-56a44826d22a 1073741824
Jun 06 01:14:24 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:25 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b68e8ba4-713c-4853-b6f6-56a44826d22a 1073741824" returned: 0 in 0.837s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b68e8ba4-713c-4853-b6f6-56a44826d22a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:25 devstack sudo[99523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b68e8ba4-713c-4853-b6f6-56a44826d22a
Jun 06 01:14:25 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:25 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b68e8ba4-713c-4853-b6f6-56a44826d22a" returned: 0 in 0.627s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:25 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:14:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3e4d89-d7c4-4556-bdd2-e1d093add70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b68e8ba4-713c-4853-b6f6-56a44826d22a', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb3d0657-e5f0-421e-8868-687049f179f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:25 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Volume volume-b68e8ba4-713c-4853-b6f6-56a44826d22a (b68e8ba4-713c-4853-b6f6-56a44826d22a): created successfully
Jun 06 01:14:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb3d0657-e5f0-421e-8868-687049f179f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Flow 'volume_create_manager' (85f3a588-7020-4bbf-97c0-ebb49d3d7162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:25 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-338e5dbb-f1f0-49b0-b3b4-7a139e78c6b7 tempest-GroupsTest-1217041605 None] Created volume successfully.
Jun 06 01:14:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] Acquiring lock "cinder-quobyte-b68e8ba4-713c-4853-b6f6-56a44826d22a" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] Lock "cinder-quobyte-b68e8ba4-713c-4853-b6f6-56a44826d22a" acquired by "delete_volume" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:26 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54ac24e-8456-4ec2-a256-7aab193f2572]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b68e8ba4-713c-4853-b6f6-56a44826d22a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:26 devstack sudo[99528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b68e8ba4-713c-4853-b6f6-56a44826d22a
Jun 06 01:14:26 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:27 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b68e8ba4-713c-4853-b6f6-56a44826d22a" returned: 0 in 0.702s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b68e8ba4-713c-4853-b6f6-56a44826d22a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:27 devstack sudo[99533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b68e8ba4-713c-4853-b6f6-56a44826d22a
Jun 06 01:14:27 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:28 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b68e8ba4-713c-4853-b6f6-56a44826d22a" returned: 0 in 0.591s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:28 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] Lock "cinder-quobyte-b68e8ba4-713c-4853-b6f6-56a44826d22a" released by "delete_volume" :: held 1.343s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:28 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] Created reservations ['a3801615-a795-4a95-9d4d-99e86df6dd6b'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:28 devstack cinder-volume[86581]: WARNING cinder.quota [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-114764699 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-114764699, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:14:28 devstack cinder-volume[86581]: WARNING cinder.quota [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-114764699 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-114764699, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:14:28 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] Created reservations ['c2dd4022-60ac-40ba-a318-4eeab64a5729', '7b7e7de3-a1da-4922-87fb-53c12126c1a9', '80efc4cc-0deb-4f54-9ba0-d5b2cee4b3ad', '4442be58-d046-454e-9fb9-e6a70a1756e9'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:28 devstack sudo[99536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:14:28 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:28 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.601s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:29 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:14:29 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-342b8f4f-e50f-4d3a-831d-e306d96e3a6e tempest-GroupsTest-1217041605 None] Delete group completed successfully.
Jun 06 01:14:29 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-c0113c27-9474-48de-9eb3-15335be34b26 tempest-GroupsTest-1217041605 None] Created reservations ['8324e693-ec40-4a06-a07c-ea4ae77980e9'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c0113c27-9474-48de-9eb3-15335be34b26 tempest-GroupsTest-1217041605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c0113c27-9474-48de-9eb3-15335be34b26 tempest-GroupsTest-1217041605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c0113c27-9474-48de-9eb3-15335be34b26 tempest-GroupsTest-1217041605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c0113c27-9474-48de-9eb3-15335be34b26 tempest-GroupsTest-1217041605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c0113c27-9474-48de-9eb3-15335be34b26 tempest-GroupsTest-1217041605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c0113c27-9474-48de-9eb3-15335be34b26 tempest-GroupsTest-1217041605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:29 devstack sudo[99539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:14:29 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:29 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c0113c27-9474-48de-9eb3-15335be34b26 tempest-GroupsTest-1217041605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.632s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:29 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-c0113c27-9474-48de-9eb3-15335be34b26 tempest-GroupsTest-1217041605 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:14:29 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c0113c27-9474-48de-9eb3-15335be34b26 tempest-GroupsTest-1217041605 None] Delete group completed successfully.
Jun 06 01:14:30 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-53d360e2-8a35-4a9e-b56b-05f2c270a5ba tempest-GroupsTest-1217041605 None] Group tempest-GroupsTest-Group-1370857863: creating
Jun 06 01:14:30 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-53d360e2-8a35-4a9e-b56b-05f2c270a5ba tempest-GroupsTest-1217041605 None] Group tempest-GroupsTest-Group-1370857863: created successfully
Jun 06 01:14:30 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-53d360e2-8a35-4a9e-b56b-05f2c270a5ba tempest-GroupsTest-1217041605 None] Create group completed successfully.
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Flow 'volume_create_manager' (3708d8a7-9035-48ca-8371-60848c2a0a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c41b90c-53b6-410c-bf6a-78ca7d9b1b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c41b90c-53b6-410c-bf6a-78ca7d9b1b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1558764325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07eb19e7-efcc-4e03-aaef-d47c7b892bc0,host='devstack@QuobyteHD#QuobyteHD',id=0e4bc2a4-f248-4693-9aa5-7d149bab30e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadd26a022224f3cb00d4b30c9b3fb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:32Z,use_quota=True,user_id='8c868e6260a34f419c72481c2768d9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2aae6293-868b-4841-aa5d-a267763c0a26),volume_type_id=2aae6293-868b-4841-aa5d-a267763c0a26)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11644c2c-024a-4702-9937-cabac000464a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11644c2c-024a-4702-9937-cabac000464a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed44d8ad-3c8c-4fa4-8a98-24fab9979afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed44d8ad-3c8c-4fa4-8a98-24fab9979afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e4bc2a4-f248-4693-9aa5-7d149bab30e8', 'volume_name': 'volume-0e4bc2a4-f248-4693-9aa5-7d149bab30e8', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2bda10-4614-4afd-af4a-a1610321aae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2bda10-4614-4afd-af4a-a1610321aae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2cf4d2-f646-44ee-bf5e-88a1a1e22086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:32 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Volume 0e4bc2a4-f248-4693-9aa5-7d149bab30e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e4bc2a4-f248-4693-9aa5-7d149bab30e8', 'volume_size': 1}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=07eb19e7-efcc-4e03-aaef-d47c7b892bc0,created_at=2026-06-05T23:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1558764325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07eb19e7-efcc-4e03-aaef-d47c7b892bc0,host='devstack@QuobyteHD#QuobyteHD',id=0e4bc2a4-f248-4693-9aa5-7d149bab30e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadd26a022224f3cb00d4b30c9b3fb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:32Z,use_quota=True,user_id='8c868e6260a34f419c72481c2768d9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2aae6293-868b-4841-aa5d-a267763c0a26),volume_type_id=2aae6293-868b-4841-aa5d-a267763c0a26)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Creating volume 0e4bc2a4-f248-4693-9aa5-7d149bab30e8 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:14:32 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:14:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0e4bc2a4-f248-4693-9aa5-7d149bab30e8 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:32 devstack sudo[99542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0e4bc2a4-f248-4693-9aa5-7d149bab30e8 1073741824
Jun 06 01:14:32 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:33 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0e4bc2a4-f248-4693-9aa5-7d149bab30e8 1073741824" returned: 0 in 0.796s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0e4bc2a4-f248-4693-9aa5-7d149bab30e8 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:33 devstack sudo[99549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0e4bc2a4-f248-4693-9aa5-7d149bab30e8
Jun 06 01:14:33 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Flow 'volume_create_manager' (12beee07-a418-4446-b236-873cffb2c3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a70c48-f43a-4df4-bcf6-50fa634d636c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a70c48-f43a-4df4-bcf6-50fa634d636c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-293032092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43839bd-2810-4507-a5c0-462bfee1c6fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85778eceb4724f87ac9eb1695c0bf96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:33Z,use_quota=True,user_id='c60ab416f40242e4958b04382330d5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbcbd4f-fbb3-4139-b86d-138f2b32aa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbcbd4f-fbb3-4139-b86d-138f2b32aa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19280f40-6282-43a8-b1e2-83c9be370747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19280f40-6282-43a8-b1e2-83c9be370747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b43839bd-2810-4507-a5c0-462bfee1c6fc', 'volume_name': 'volume-b43839bd-2810-4507-a5c0-462bfee1c6fc', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408f8afa-5355-4b9d-8eea-32d97d0453eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408f8afa-5355-4b9d-8eea-32d97d0453eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4548da20-1349-4b2b-8475-6a778c89bb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:33 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Volume b43839bd-2810-4507-a5c0-462bfee1c6fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b43839bd-2810-4507-a5c0-462bfee1c6fc', 'volume_size': 1}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:33 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0e4bc2a4-f248-4693-9aa5-7d149bab30e8" returned: 0 in 0.606s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.485s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-293032092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43839bd-2810-4507-a5c0-462bfee1c6fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85778eceb4724f87ac9eb1695c0bf96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:33Z,use_quota=True,user_id='c60ab416f40242e4958b04382330d5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Creating volume b43839bd-2810-4507-a5c0-462bfee1c6fc {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:14:33 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b43839bd-2810-4507-a5c0-462bfee1c6fc 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2cf4d2-f646-44ee-bf5e-88a1a1e22086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e4bc2a4-f248-4693-9aa5-7d149bab30e8', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:33 devstack sudo[99552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b43839bd-2810-4507-a5c0-462bfee1c6fc 1073741824
Jun 06 01:14:33 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda20192-d778-41e3-99fd-7a715499cd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:33 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Volume volume-0e4bc2a4-f248-4693-9aa5-7d149bab30e8 (0e4bc2a4-f248-4693-9aa5-7d149bab30e8): created successfully
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda20192-d778-41e3-99fd-7a715499cd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Flow 'volume_create_manager' (3708d8a7-9035-48ca-8371-60848c2a0a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:33 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-3336ea7b-7c58-42fc-bb81-c4b94276303d tempest-GroupsTest-1217041605 None] Created volume successfully.
Jun 06 01:14:34 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b43839bd-2810-4507-a5c0-462bfee1c6fc 1073741824" returned: 0 in 0.774s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b43839bd-2810-4507-a5c0-462bfee1c6fc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:34 devstack sudo[99558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b43839bd-2810-4507-a5c0-462bfee1c6fc
Jun 06 01:14:34 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:34 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:14:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Flow 'volume_create_manager' (58474fca-2485-4fcb-a19b-12d29c8ea663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8090107-2117-4e6b-8e6f-06932d4998de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8090107-2117-4e6b-8e6f-06932d4998de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2124769148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07eb19e7-efcc-4e03-aaef-d47c7b892bc0,host='devstack@QuobyteHD#QuobyteHD',id=146e4a15-e68e-46e4-a2a9-41267792b8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadd26a022224f3cb00d4b30c9b3fb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:35Z,use_quota=True,user_id='8c868e6260a34f419c72481c2768d9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2aae6293-868b-4841-aa5d-a267763c0a26),volume_type_id=2aae6293-868b-4841-aa5d-a267763c0a26)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facf75ac-4b44-4d78-9f6d-cc52e02bb69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facf75ac-4b44-4d78-9f6d-cc52e02bb69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e3c119-f9d3-4393-80b1-4c67d650ce0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e3c119-f9d3-4393-80b1-4c67d650ce0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '146e4a15-e68e-46e4-a2a9-41267792b8e2', 'volume_name': 'volume-146e4a15-e68e-46e4-a2a9-41267792b8e2', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86a6c20-65cf-4109-8e4e-f3010a1f7287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86a6c20-65cf-4109-8e4e-f3010a1f7287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40385f52-ea0a-49a0-9259-a5aeb67fbcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:34 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Volume 146e4a15-e68e-46e4-a2a9-41267792b8e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-146e4a15-e68e-46e4-a2a9-41267792b8e2', 'volume_size': 1}
Jun 06 01:14:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:35 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b43839bd-2810-4507-a5c0-462bfee1c6fc" returned: 0 in 0.659s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:14:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.252s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=07eb19e7-efcc-4e03-aaef-d47c7b892bc0,created_at=2026-06-05T23:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2124769148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07eb19e7-efcc-4e03-aaef-d47c7b892bc0,host='devstack@QuobyteHD#QuobyteHD',id=146e4a15-e68e-46e4-a2a9-41267792b8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadd26a022224f3cb00d4b30c9b3fb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:35Z,use_quota=True,user_id='8c868e6260a34f419c72481c2768d9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2aae6293-868b-4841-aa5d-a267763c0a26),volume_type_id=2aae6293-868b-4841-aa5d-a267763c0a26)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:14:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Creating volume 146e4a15-e68e-46e4-a2a9-41267792b8e2 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:14:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:14:35 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:14:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-146e4a15-e68e-46e4-a2a9-41267792b8e2 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4548da20-1349-4b2b-8475-6a778c89bb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43839bd-2810-4507-a5c0-462bfee1c6fc', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (837cabc6-ff91-4950-a8a7-e8c28ab5ffa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:35 devstack sudo[99561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-146e4a15-e68e-46e4-a2a9-41267792b8e2 1073741824
Jun 06 01:14:35 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:35 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Volume volume-b43839bd-2810-4507-a5c0-462bfee1c6fc (b43839bd-2810-4507-a5c0-462bfee1c6fc): created successfully
Jun 06 01:14:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (837cabc6-ff91-4950-a8a7-e8c28ab5ffa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Flow 'volume_create_manager' (12beee07-a418-4446-b236-873cffb2c3e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:35 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-4781de85-c842-4c5f-b91a-575123f3bbe4 tempest-VolumeQuotasAdminTestJSON-529067613 None] Created volume successfully.
Jun 06 01:14:36 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-146e4a15-e68e-46e4-a2a9-41267792b8e2 1073741824" returned: 0 in 0.767s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-146e4a15-e68e-46e4-a2a9-41267792b8e2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:36 devstack sudo[99566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-146e4a15-e68e-46e4-a2a9-41267792b8e2
Jun 06 01:14:36 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:36 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] Acquiring lock "cinder-b43839bd-2810-4507-a5c0-462bfee1c6fc-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:36 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] Lock "cinder-b43839bd-2810-4507-a5c0-462bfee1c6fc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:36 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] Acquiring lock "cinder-quobyte-b43839bd-2810-4507-a5c0-462bfee1c6fc" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:36 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] Lock "cinder-quobyte-b43839bd-2810-4507-a5c0-462bfee1c6fc" acquired by "delete_volume" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:36 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7a4e6e-4a14-4514-89ff-26cde3b677c7]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b43839bd-2810-4507-a5c0-462bfee1c6fc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:36 devstack sudo[99568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b43839bd-2810-4507-a5c0-462bfee1c6fc
Jun 06 01:14:36 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:36 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-146e4a15-e68e-46e4-a2a9-41267792b8e2" returned: 0 in 0.635s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:36 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:14:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:36 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40385f52-ea0a-49a0-9259-a5aeb67fbcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-146e4a15-e68e-46e4-a2a9-41267792b8e2', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:36 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecf0e63-a97f-4513-8fb2-fcd9d2d9d74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:36 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Volume volume-146e4a15-e68e-46e4-a2a9-41267792b8e2 (146e4a15-e68e-46e4-a2a9-41267792b8e2): created successfully
Jun 06 01:14:36 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecf0e63-a97f-4513-8fb2-fcd9d2d9d74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:36 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Flow 'volume_create_manager' (58474fca-2485-4fcb-a19b-12d29c8ea663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:36 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-27eed39f-a646-44b6-a177-b1ee4f50fc3f tempest-GroupsTest-1217041605 None] Created volume successfully.
Jun 06 01:14:37 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-17845846-0203-4a4c-b7f7-6c98dcdec4b5 tempest-GroupsTest-1217041605 None] Update group completed successfully.
Jun 06 01:14:37 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b43839bd-2810-4507-a5c0-462bfee1c6fc" returned: 0 in 0.739s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b43839bd-2810-4507-a5c0-462bfee1c6fc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:37 devstack sudo[99576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b43839bd-2810-4507-a5c0-462bfee1c6fc
Jun 06 01:14:37 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:37 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b43839bd-2810-4507-a5c0-462bfee1c6fc" returned: 0 in 0.589s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:37 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] Lock "cinder-quobyte-b43839bd-2810-4507-a5c0-462bfee1c6fc" released by "delete_volume" :: held 1.372s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:37 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=147,cinder:UPDATE=139,cinder:INSERT=30,cinder:DELETE=2 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:14:37 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=124,cinder:UPDATE=130,cinder:INSERT=33,cinder:DELETE=9 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:14:37 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] Created reservations ['10e57fc6-e68e-4f64-b17e-2bb916b3eee7', '0871a201-33c0-446a-8845-34889257675f', '0d6eb3b9-d2b1-48ea-bb7e-534a2366b207', 'e56181a3-032f-40a1-91b9-1f26f1d528d6'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:38 devstack sudo[99579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:14:38 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:38 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-388ff4e5-e0a6-4e89-8edc-04f9ac3997bd tempest-GroupsTest-1217041605 None] Update group completed successfully.
Jun 06 01:14:38 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.597s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:38 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:14:38 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] Deleted volume successfully.
Jun 06 01:14:38 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-651c56ec-e3f6-4f6a-8876-eb58ff4ccec5 tempest-VolumeQuotasAdminTestJSON-529067613 None] Lock "cinder-b43839bd-2810-4507-a5c0-462bfee1c6fc-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Flow 'volume_create_manager' (68d1cbe8-4a5e-4060-8139-0b2539d78024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0992dd08-0719-4c8a-a092-206dd06e08ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0992dd08-0719-4c8a-a092-206dd06e08ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1668939736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38252dc4-fe25-43ab-b2e8-8347b7cd723d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85778eceb4724f87ac9eb1695c0bf96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:39Z,use_quota=True,user_id='c60ab416f40242e4958b04382330d5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a831acd-2ca9-4e5b-be5a-5ee13ca225c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a831acd-2ca9-4e5b-be5a-5ee13ca225c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8af48e-7d2d-417e-8883-dbbc90991f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8af48e-7d2d-417e-8883-dbbc90991f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38252dc4-fe25-43ab-b2e8-8347b7cd723d', 'volume_name': 'volume-38252dc4-fe25-43ab-b2e8-8347b7cd723d', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb093de-2b73-46d1-8304-a041b38f22f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb093de-2b73-46d1-8304-a041b38f22f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f85d2d2-6a4c-4a8a-8d8a-eabc588d9149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:39 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Volume 38252dc4-fe25-43ab-b2e8-8347b7cd723d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38252dc4-fe25-43ab-b2e8-8347b7cd723d', 'volume_size': 1}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1668939736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38252dc4-fe25-43ab-b2e8-8347b7cd723d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85778eceb4724f87ac9eb1695c0bf96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:39Z,use_quota=True,user_id='c60ab416f40242e4958b04382330d5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Creating volume 38252dc4-fe25-43ab-b2e8-8347b7cd723d {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:14:39 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38252dc4-fe25-43ab-b2e8-8347b7cd723d 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:39 devstack sudo[99582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38252dc4-fe25-43ab-b2e8-8347b7cd723d 1073741824
Jun 06 01:14:39 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Acquiring lock "cinder-quobyte-0e4bc2a4-f248-4693-9aa5-7d149bab30e8" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Lock "cinder-quobyte-0e4bc2a4-f248-4693-9aa5-7d149bab30e8" acquired by "delete_volume" :: waited 0.025s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[633e3a7a-c899-4ef8-8e3c-859e9f42ca08]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0e4bc2a4-f248-4693-9aa5-7d149bab30e8 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:40 devstack sudo[99587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0e4bc2a4-f248-4693-9aa5-7d149bab30e8
Jun 06 01:14:40 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:40 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38252dc4-fe25-43ab-b2e8-8347b7cd723d 1073741824" returned: 0 in 0.844s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38252dc4-fe25-43ab-b2e8-8347b7cd723d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:40 devstack sudo[99590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38252dc4-fe25-43ab-b2e8-8347b7cd723d
Jun 06 01:14:40 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:40 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0e4bc2a4-f248-4693-9aa5-7d149bab30e8" returned: 0 in 0.726s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0e4bc2a4-f248-4693-9aa5-7d149bab30e8 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:40 devstack sudo[99595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0e4bc2a4-f248-4693-9aa5-7d149bab30e8
Jun 06 01:14:40 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:40 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38252dc4-fe25-43ab-b2e8-8347b7cd723d" returned: 0 in 0.608s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:14:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f85d2d2-6a4c-4a8a-8d8a-eabc588d9149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38252dc4-fe25-43ab-b2e8-8347b7cd723d', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711016a8-3eb7-4426-a5e4-b6ad41723afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:40 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Volume volume-38252dc4-fe25-43ab-b2e8-8347b7cd723d (38252dc4-fe25-43ab-b2e8-8347b7cd723d): created successfully
Jun 06 01:14:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711016a8-3eb7-4426-a5e4-b6ad41723afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Flow 'volume_create_manager' (68d1cbe8-4a5e-4060-8139-0b2539d78024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:40 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b5490fb5-ebba-4ee5-b8f0-5cb4e40fc865 tempest-VolumeQuotasAdminTestJSON-529067613 None] Created volume successfully.
Jun 06 01:14:41 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0e4bc2a4-f248-4693-9aa5-7d149bab30e8" returned: 0 in 0.610s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Lock "cinder-quobyte-0e4bc2a4-f248-4693-9aa5-7d149bab30e8" released by "delete_volume" :: held 1.378s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Acquiring lock "cinder-quobyte-146e4a15-e68e-46e4-a2a9-41267792b8e2" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Lock "cinder-quobyte-146e4a15-e68e-46e4-a2a9-41267792b8e2" acquired by "delete_volume" :: waited 0.012s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:41 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9d83e0-65f6-45b2-a2af-4da85d7e5bac]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-146e4a15-e68e-46e4-a2a9-41267792b8e2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:41 devstack sudo[99599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-146e4a15-e68e-46e4-a2a9-41267792b8e2
Jun 06 01:14:41 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:41 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-45300818-22cc-4a7a-869c-81aa6c895122 tempest-VolumeQuotasAdminTestJSON-1846939386 None] Transfer volume completed successfully.
Jun 06 01:14:42 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-146e4a15-e68e-46e4-a2a9-41267792b8e2" returned: 0 in 0.719s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-146e4a15-e68e-46e4-a2a9-41267792b8e2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:42 devstack sudo[99604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-146e4a15-e68e-46e4-a2a9-41267792b8e2
Jun 06 01:14:42 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:42 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-146e4a15-e68e-46e4-a2a9-41267792b8e2" returned: 0 in 0.643s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:42 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Lock "cinder-quobyte-146e4a15-e68e-46e4-a2a9-41267792b8e2" released by "delete_volume" :: held 1.406s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:42 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Created reservations ['85751022-0461-49e5-abcc-bfaf974a3d1a'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:42 devstack cinder-volume[86581]: WARNING cinder.quota [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-578281679 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-578281679, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:14:42 devstack cinder-volume[86581]: WARNING cinder.quota [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-578281679 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-578281679, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:14:42 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Created reservations ['b957bdd3-e6f4-415b-8504-c363bdfaeea9', '4a07e043-8f14-4e30-924f-a27cf9d27d95', 'd67ab0cc-c112-4e85-9e99-5a6d532645c8', 'b403b362-1dcf-44de-b5bc-d5983f241a92'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:42 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] Acquiring lock "cinder-38252dc4-fe25-43ab-b2e8-8347b7cd723d-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:42 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] Lock "cinder-38252dc4-fe25-43ab-b2e8-8347b7cd723d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:42 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] Acquiring lock "cinder-quobyte-38252dc4-fe25-43ab-b2e8-8347b7cd723d" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:42 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Created reservations ['3b6ac8e0-1f2a-4d81-a9ad-2a5a56fb0be1', '1374b194-fa2c-41a3-9c85-973d88d00504', '00946e3d-ad04-4fcf-8741-f44712cae300', '7db5100d-2bd4-443f-9347-f0074205b844'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:42 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] Lock "cinder-quobyte-38252dc4-fe25-43ab-b2e8-8347b7cd723d" acquired by "delete_volume" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:42 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55aa0bd-ec2a-4a73-a70d-745504cade9c]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38252dc4-fe25-43ab-b2e8-8347b7cd723d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:43 devstack sudo[99608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38252dc4-fe25-43ab-b2e8-8347b7cd723d
Jun 06 01:14:43 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:43 devstack sudo[99609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:14:43 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:43 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38252dc4-fe25-43ab-b2e8-8347b7cd723d" returned: 0 in 0.757s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38252dc4-fe25-43ab-b2e8-8347b7cd723d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:43 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.674s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:43 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:14:43 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b557fe32-4854-4acd-89e5-25fc18b51744 tempest-GroupsTest-1217041605 None] Delete group completed successfully.
Jun 06 01:14:43 devstack sudo[99617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38252dc4-fe25-43ab-b2e8-8347b7cd723d
Jun 06 01:14:43 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:44 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38252dc4-fe25-43ab-b2e8-8347b7cd723d" returned: 0 in 0.664s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:44 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] Lock "cinder-quobyte-38252dc4-fe25-43ab-b2e8-8347b7cd723d" released by "delete_volume" :: held 1.466s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:44 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] Created reservations ['111e40d4-daf9-4fa8-acb9-9bfe2904221c', 'd3ba6e6d-400a-447b-b5b4-532405c365bb', 'b57a54f4-17fd-4a20-87db-c3ce25652b12', '9cd10aa2-0a1b-4d22-9ccc-c7185f1167ca'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:44 devstack sudo[99620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:14:44 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:45 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.634s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:45 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:14:45 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] Deleted volume successfully.
Jun 06 01:14:45 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-898bbc75-fd9e-4caa-9a0f-f747598c1beb tempest-VolumeQuotasAdminTestJSON-545237234 None] Lock "cinder-38252dc4-fe25-43ab-b2e8-8347b7cd723d-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:48 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-67d7c908-c8cb-41be-96cb-fafa910d3c4c tempest-GroupsV314Test-949338008 None] Group tempest-GroupsV314Test-Group-487490584: creating
Jun 06 01:14:48 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-67d7c908-c8cb-41be-96cb-fafa910d3c4c tempest-GroupsV314Test-949338008 None] Group tempest-GroupsV314Test-Group-487490584: created successfully
Jun 06 01:14:48 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-67d7c908-c8cb-41be-96cb-fafa910d3c4c tempest-GroupsV314Test-949338008 None] Create group completed successfully.
Jun 06 01:14:49 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:14:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Flow 'volume_create_manager' (92b139d8-fe93-4d40-81e7-bf9a872d88f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994d60cb-4db9-4581-acb7-39e22bec8b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994d60cb-4db9-4581-acb7-39e22bec8b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1018856203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4a5ba34c-0047-4789-874a-6f28dcb392f7,host='devstack@QuobyteHD#QuobyteHD',id=7b43032a-0708-402e-9151-9839b3f52c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0b9e6312504f358b8b1aa12553c0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:50Z,use_quota=True,user_id='13c0a41070e24c4da398498b745c69f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f553fe2-0626-4400-98a1-e2f304f46ce9),volume_type_id=2f553fe2-0626-4400-98a1-e2f304f46ce9)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (accf3add-e3a0-458c-8c7c-87cc31894fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (accf3add-e3a0-458c-8c7c-87cc31894fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b560d0-832f-41c4-884e-59ef1ca2b3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b560d0-832f-41c4-884e-59ef1ca2b3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b43032a-0708-402e-9151-9839b3f52c52', 'volume_name': 'volume-7b43032a-0708-402e-9151-9839b3f52c52', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4331908d-91fe-4918-a9c7-689a43edfe56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4331908d-91fe-4918-a9c7-689a43edfe56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef0a129-353f-4582-8470-e94a7f651a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:50 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Volume 7b43032a-0708-402e-9151-9839b3f52c52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b43032a-0708-402e-9151-9839b3f52c52', 'volume_size': 1}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4a5ba34c-0047-4789-874a-6f28dcb392f7,created_at=2026-06-05T23:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1018856203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4a5ba34c-0047-4789-874a-6f28dcb392f7,host='devstack@QuobyteHD#QuobyteHD',id=7b43032a-0708-402e-9151-9839b3f52c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0b9e6312504f358b8b1aa12553c0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:50Z,use_quota=True,user_id='13c0a41070e24c4da398498b745c69f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f553fe2-0626-4400-98a1-e2f304f46ce9),volume_type_id=2f553fe2-0626-4400-98a1-e2f304f46ce9)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Creating volume 7b43032a-0708-402e-9151-9839b3f52c52 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:14:50 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:50 devstack sudo[99626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52 1073741824
Jun 06 01:14:50 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:50 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52 1073741824" returned: 0 in 0.781s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:50 devstack sudo[99632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52
Jun 06 01:14:50 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:51 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52" returned: 0 in 0.592s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef0a129-353f-4582-8470-e94a7f651a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b43032a-0708-402e-9151-9839b3f52c52', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578be05f-5d6d-48e3-9b84-c1d2be63fcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:51 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Volume volume-7b43032a-0708-402e-9151-9839b3f52c52 (7b43032a-0708-402e-9151-9839b3f52c52): created successfully
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578be05f-5d6d-48e3-9b84-c1d2be63fcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Flow 'volume_create_manager' (92b139d8-fe93-4d40-81e7-bf9a872d88f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:51 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d41622b2-7a6c-4256-b1b6-31001af74662 tempest-GroupsV314Test-949338008 None] Created volume successfully.
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Flow 'volume_create_manager' (1a9db7b6-0a4e-4a62-9655-8c1151228cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d66df03-d079-4cc5-917d-f06325278a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d66df03-d079-4cc5-917d-f06325278a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1389241456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4d770b-e094-4acf-8e4f-61218c438e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4791bef435d54c899c19a76b71e3b00d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:52Z,use_quota=True,user_id='434ca038f84e4fca9f82c1386b7a3f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d412d6f-2a50-41d4-9596-7c5f668c995b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d412d6f-2a50-41d4-9596-7c5f668c995b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ef99fb-1409-466f-954a-5b455a519904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ef99fb-1409-466f-954a-5b455a519904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c4d770b-e094-4acf-8e4f-61218c438e0a', 'volume_name': 'volume-5c4d770b-e094-4acf-8e4f-61218c438e0a', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef93cd1-270e-4353-870d-ddd754a768db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef93cd1-270e-4353-870d-ddd754a768db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5987408b-4a25-4fcc-a796-cfc40767def2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:51 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Volume 5c4d770b-e094-4acf-8e4f-61218c438e0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c4d770b-e094-4acf-8e4f-61218c438e0a', 'volume_size': 1}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1389241456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4d770b-e094-4acf-8e4f-61218c438e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4791bef435d54c899c19a76b71e3b00d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:14:52Z,use_quota=True,user_id='434ca038f84e4fca9f82c1386b7a3f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Creating volume 5c4d770b-e094-4acf-8e4f-61218c438e0a {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:14:51 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:14:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5c4d770b-e094-4acf-8e4f-61218c438e0a 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:51 devstack sudo[99635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5c4d770b-e094-4acf-8e4f-61218c438e0a 1073741824
Jun 06 01:14:51 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:52 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5c4d770b-e094-4acf-8e4f-61218c438e0a 1073741824" returned: 0 in 0.752s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5c4d770b-e094-4acf-8e4f-61218c438e0a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:52 devstack sudo[99640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5c4d770b-e094-4acf-8e4f-61218c438e0a
Jun 06 01:14:52 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:53 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5c4d770b-e094-4acf-8e4f-61218c438e0a" returned: 0 in 0.607s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:14:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.095s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:53 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Cloning volume 7b43032a-0708-402e-9151-9839b3f52c52 to volume ee30a5d6-66de-49d1-80e9-256bd528ad9c
Jun 06 01:14:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5987408b-4a25-4fcc-a796-cfc40767def2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c4d770b-e094-4acf-8e4f-61218c438e0a', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0eb01ba-3402-4bb0-8d69-e6c3d65d0b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:14:53 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Volume volume-5c4d770b-e094-4acf-8e4f-61218c438e0a (5c4d770b-e094-4acf-8e4f-61218c438e0a): created successfully
Jun 06 01:14:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0eb01ba-3402-4bb0-8d69-e6c3d65d0b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:14:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Flow 'volume_create_manager' (1a9db7b6-0a4e-4a62-9655-8c1151228cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:14:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Creating offline snapshot 907d795f-f84d-4f86-833e-23dbff89db21 of volume 7b43032a-0708-402e-9151-9839b3f52c52 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:14:53 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-e3f3c8cd-2228-4dc4-9cde-33257fe19643 tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Created volume successfully.
Jun 06 01:14:53 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f173787-298c-4f65-a7f1-38fee6c228da]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:53 devstack sudo[99644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52
Jun 06 01:14:53 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:53 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52" returned: 0 in 0.710s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:54 devstack sudo[99649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21 1G
Jun 06 01:14:54 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Acquiring lock "cinder-5c4d770b-e094-4acf-8e4f-61218c438e0a-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:54 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21 1G" returned: 0 in 0.800s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b43032a-0708-402e-9151-9839b3f52c52 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Lock "cinder-5c4d770b-e094-4acf-8e4f-61218c438e0a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:54 devstack sudo[99655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b43032a-0708-402e-9151-9839b3f52c52 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21
Jun 06 01:14:54 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Acquiring lock "cinder-quobyte-5c4d770b-e094-4acf-8e4f-61218c438e0a" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Lock "cinder-quobyte-5c4d770b-e094-4acf-8e4f-61218c438e0a" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:54 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df77985-6db4-49df-a403-2a46e8672b63]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5c4d770b-e094-4acf-8e4f-61218c438e0a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:55 devstack sudo[99657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5c4d770b-e094-4acf-8e4f-61218c438e0a
Jun 06 01:14:55 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:55 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b43032a-0708-402e-9151-9839b3f52c52 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21" returned: 0 in 0.679s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:55 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21 is being set with open permissions: ugo+rw: NotImplementedError
Jun 06 01:14:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:55 devstack sudo[99662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21
Jun 06 01:14:55 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:55 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5c4d770b-e094-4acf-8e4f-61218c438e0a" returned: 0 in 0.747s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5c4d770b-e094-4acf-8e4f-61218c438e0a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:55 devstack sudo[99667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5c4d770b-e094-4acf-8e4f-61218c438e0a
Jun 06 01:14:55 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:56 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21" returned: 0 in 0.606s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:56 devstack sudo[99670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.info
Jun 06 01:14:56 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:56 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5c4d770b-e094-4acf-8e4f-61218c438e0a" returned: 0 in 0.603s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Lock "cinder-quobyte-5c4d770b-e094-4acf-8e4f-61218c438e0a" released by "delete_volume" :: held 1.395s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:56 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Created reservations ['0968f8cc-cb0a-413f-9684-38435f2f596c', '0647a313-0b3f-4a89-91a1-db0d5d5cd384', 'fd064bc6-cca6-4448-842b-36040bd3cc79', 'eec38ee5-a04c-4733-9782-f93f5b7faab4'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:14:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:56 devstack sudo[99673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:14:56 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:56 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.info" returned: 0 in 0.606s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:56 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 06 01:14:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:56 devstack sudo[99676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.info
Jun 06 01:14:56 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:56 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.612s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:56 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:14:56 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Deleted volume successfully.
Jun 06 01:14:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c326fada-0220-4bb2-8ed1-7ad11339d71a tempest-VolumeQuotasNegativeTestJSON-1565765273 None] Lock "cinder-5c4d770b-e094-4acf-8e4f-61218c438e0a-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:14:57 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.info" returned: 0 in 0.609s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Acquiring lock "cinder-quobyte-ee30a5d6-66de-49d1-80e9-256bd528ad9c" by "_copy_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:14:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Lock "cinder-quobyte-ee30a5d6-66de-49d1-80e9-256bd528ad9c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:14:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] snapshot: 907d795f-f84d-4f86-833e-23dbff89db21, volume: ee30a5d6-66de-49d1-80e9-256bd528ad9c,  {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 06 01:14:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:57 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[2302d303-261b-4149-b415-86f0f439a304]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:57 devstack sudo[99680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21
Jun 06 01:14:57 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:58 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21" returned: 0 in 0.751s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b43032a-0708-402e-9151-9839b3f52c52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:14:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52 {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 06 01:14:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Creating direct copy from snapshot {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 06 01:14:58 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[0767d124-0550-4a6d-8338-ecb9c5be686d]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:14:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:58 devstack sudo[99685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52
Jun 06 01:14:58 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:58 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root
Jun 06 01:14:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52" returned: 0 in 0.720s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:14:58 devstack cinder-volume[86581]: DEBUG cinder.utils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Path /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ee30a5d6-66de-49d1-80e9-256bd528ad9c not found in is_blk_device check {{(pid=86581) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jun 06 01:14:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ee30a5d6-66de-49d1-80e9-256bd528ad9c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:58 devstack sudo[99690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ee30a5d6-66de-49d1-80e9-256bd528ad9c
Jun 06 01:14:58 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:14:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:14:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:14:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:14:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:14:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:14:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:14:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:14:59 devstack sudo[99692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:14:59 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:00 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.090s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:15:03 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ee30a5d6-66de-49d1-80e9-256bd528ad9c" returned: 0 in 4.965s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:03 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a0107c-ae1e-49d1-83f1-08da6bd6e162]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:03 devstack sudo[99715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52
Jun 06 01:15:03 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:04 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52" returned: 0 in 0.894s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:04 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Image conversion details: src /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ee30a5d6-66de-49d1-80e9-256bd528ad9c {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:15:04 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Converted 1024.00 MB image at 206.18 MB/s
Jun 06 01:15:04 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ee30a5d6-66de-49d1-80e9-256bd528ad9c is being set with open permissions: ugo+rw: NotImplementedError
Jun 06 01:15:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ee30a5d6-66de-49d1-80e9-256bd528ad9c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:04 devstack sudo[99720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ee30a5d6-66de-49d1-80e9-256bd528ad9c
Jun 06 01:15:04 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Flow 'volume_create_manager' (970e1fdf-d626-42d0-8e22-c42507194816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6fccebd-7383-44ba-9a5a-bd39ddfbb57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6fccebd-7383-44ba-9a5a-bd39ddfbb57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2115469908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62241ed-21e9-4750-b7d0-2cbfe564948a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ece419b60fe402fa976043bbd99f023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:15:05Z,use_quota=True,user_id='09a04c9a547140eab55d559623590478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3faebd7d-34eb-4225-909f-5ce443f1bdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3faebd7d-34eb-4225-909f-5ce443f1bdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2115964-ffdf-40db-b8de-4d3e11b34251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2115964-ffdf-40db-b8de-4d3e11b34251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b62241ed-21e9-4750-b7d0-2cbfe564948a', 'volume_name': 'volume-b62241ed-21e9-4750-b7d0-2cbfe564948a', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e067ec92-f739-4a4b-9279-5c7888c6da21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e067ec92-f739-4a4b-9279-5c7888c6da21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3676340e-0d70-4fa1-988e-5a30107be09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:05 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Volume b62241ed-21e9-4750-b7d0-2cbfe564948a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b62241ed-21e9-4750-b7d0-2cbfe564948a', 'volume_size': 1}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:05 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ee30a5d6-66de-49d1-80e9-256bd528ad9c" returned: 0 in 0.587s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Lock "cinder-quobyte-ee30a5d6-66de-49d1-80e9-256bd528ad9c" released by "_copy_volume_from_snapshot" :: held 7.998s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Acquiring lock "cinder-quobyte-907d795f-f84d-4f86-833e-23dbff89db21" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Lock "cinder-quobyte-907d795f-f84d-4f86-833e-23dbff89db21" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Deleting offline snapshot 907d795f-f84d-4f86-833e-23dbff89db21 of volume 7b43032a-0708-402e-9151-9839b3f52c52 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] snapshot_file for this snap is: volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e416a4-b364-4405-8467-db15622a045f]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:05 devstack sudo[99723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21
Jun 06 01:15:05 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:06 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21" returned: 0 in 0.717s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b43032a-0708-402e-9151-9839b3f52c52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:15:06 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66582a7-a357-4fb7-bda2-e95ddbe0ad88]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:06 devstack sudo[99728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52
Jun 06 01:15:06 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:06 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52" returned: 0 in 0.704s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:06 devstack sudo[99733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21
Jun 06 01:15:06 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:07 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21" returned: 0 in 0.665s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:07 devstack sudo[99738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21
Jun 06 01:15:07 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:08 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52.907d795f-f84d-4f86-833e-23dbff89db21" returned: 0 in 0.578s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:08 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Lock "cinder-quobyte-907d795f-f84d-4f86-833e-23dbff89db21" released by "_delete_snapshot" :: held 2.741s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.934s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.916s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2115469908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62241ed-21e9-4750-b7d0-2cbfe564948a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ece419b60fe402fa976043bbd99f023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:15:05Z,use_quota=True,user_id='09a04c9a547140eab55d559623590478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:15:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Creating volume b62241ed-21e9-4750-b7d0-2cbfe564948a {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:15:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:15:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:15:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:15:08 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:15:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b62241ed-21e9-4750-b7d0-2cbfe564948a 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:08 devstack sudo[99741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b62241ed-21e9-4750-b7d0-2cbfe564948a 1073741824
Jun 06 01:15:08 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:08 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-1ea60a4c-c745-47a9-86fd-b6294f2b916b tempest-GroupsV314Test-949338008 None] Create group from source-group-4a5ba34c-0047-4789-874a-6f28dcb392f7 completed successfully.
Jun 06 01:15:08 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b62241ed-21e9-4750-b7d0-2cbfe564948a 1073741824" returned: 0 in 0.750s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b62241ed-21e9-4750-b7d0-2cbfe564948a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:08 devstack sudo[99746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b62241ed-21e9-4750-b7d0-2cbfe564948a
Jun 06 01:15:08 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] Acquiring lock "cinder-quobyte-ee30a5d6-66de-49d1-80e9-256bd528ad9c" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] Lock "cinder-quobyte-ee30a5d6-66de-49d1-80e9-256bd528ad9c" acquired by "delete_volume" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:09 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8e1f92-1e09-4c93-bd32-18c43db4cfe8]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ee30a5d6-66de-49d1-80e9-256bd528ad9c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:09 devstack sudo[99748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ee30a5d6-66de-49d1-80e9-256bd528ad9c
Jun 06 01:15:09 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:09 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b62241ed-21e9-4750-b7d0-2cbfe564948a" returned: 0 in 0.594s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:15:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3676340e-0d70-4fa1-988e-5a30107be09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b62241ed-21e9-4750-b7d0-2cbfe564948a', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642bfaab-f9e5-4261-9fcf-980ba786a796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:09 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Volume volume-b62241ed-21e9-4750-b7d0-2cbfe564948a (b62241ed-21e9-4750-b7d0-2cbfe564948a): created successfully
Jun 06 01:15:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642bfaab-f9e5-4261-9fcf-980ba786a796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Flow 'volume_create_manager' (970e1fdf-d626-42d0-8e22-c42507194816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:15:09 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-37f57a20-234e-4740-8be3-9ea1e0d717c6 tempest-VolumesServicesTestJSON-167789424 None] Created volume successfully.
Jun 06 01:15:10 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ee30a5d6-66de-49d1-80e9-256bd528ad9c" returned: 0 in 0.725s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ee30a5d6-66de-49d1-80e9-256bd528ad9c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:10 devstack sudo[99754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ee30a5d6-66de-49d1-80e9-256bd528ad9c
Jun 06 01:15:10 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] Acquiring lock "cinder-b62241ed-21e9-4750-b7d0-2cbfe564948a-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] Lock "cinder-b62241ed-21e9-4750-b7d0-2cbfe564948a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:10 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ee30a5d6-66de-49d1-80e9-256bd528ad9c" returned: 0 in 0.628s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] Lock "cinder-quobyte-ee30a5d6-66de-49d1-80e9-256bd528ad9c" released by "delete_volume" :: held 1.405s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] Acquiring lock "cinder-quobyte-b62241ed-21e9-4750-b7d0-2cbfe564948a" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] Lock "cinder-quobyte-b62241ed-21e9-4750-b7d0-2cbfe564948a" acquired by "delete_volume" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[a858b523-efe7-4cd4-af46-91323b00a897]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b62241ed-21e9-4750-b7d0-2cbfe564948a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] Created reservations ['cb6d00e1-562a-492c-9db9-abe6d7c0edaa'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:15:10 devstack cinder-volume[86581]: WARNING cinder.quota [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-396323741 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-396323741, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:15:10 devstack cinder-volume[86581]: WARNING cinder.quota [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-396323741 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-396323741, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] Created reservations ['14550fdd-7d59-4ab3-917f-11f46d4fc7a9', '712805dd-15bd-490f-84e2-88566978ae1c', 'aff96920-f669-4757-8235-2e9aa3b2a9f7', 'e08a65ad-a605-4f2d-95f4-0838d35af291'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:15:10 devstack sudo[99757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b62241ed-21e9-4750-b7d0-2cbfe564948a
Jun 06 01:15:10 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:10 devstack sudo[99759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:15:10 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:11 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b62241ed-21e9-4750-b7d0-2cbfe564948a" returned: 0 in 0.721s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b62241ed-21e9-4750-b7d0-2cbfe564948a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:11 devstack sudo[99765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b62241ed-21e9-4750-b7d0-2cbfe564948a
Jun 06 01:15:11 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:11 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.621s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:11 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:15:11 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b10b4145-f785-4c41-9545-593105432362 tempest-GroupsV314Test-949338008 None] Delete group completed successfully.
Jun 06 01:15:11 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] Acquiring lock "cinder-quobyte-7b43032a-0708-402e-9151-9839b3f52c52" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:11 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] Lock "cinder-quobyte-7b43032a-0708-402e-9151-9839b3f52c52" acquired by "delete_volume" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:11 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb7b7ef-7ea2-481d-8db0-7b17677ee5ad]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:11 devstack sudo[99767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52
Jun 06 01:15:11 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:12 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b62241ed-21e9-4750-b7d0-2cbfe564948a" returned: 0 in 0.617s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] Lock "cinder-quobyte-b62241ed-21e9-4750-b7d0-2cbfe564948a" released by "delete_volume" :: held 1.380s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:12 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] Created reservations ['65b2d6ab-ebed-4860-9994-b33ca140efe1', '0dc4b90c-8ab6-459b-8cf0-57ab899a4824', '3dd0f2a2-dd8d-46bf-80e9-18c3b77fdd80', 'fc971e54-33a4-420d-975c-42cfdc7b12e2'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:15:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:15:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:15:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:12 devstack sudo[99804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:15:12 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:12 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52" returned: 0 in 0.730s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:12 devstack sudo[99811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52
Jun 06 01:15:12 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:12 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.632s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:12 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:15:12 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] Deleted volume successfully.
Jun 06 01:15:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-84affa58-1e77-46ae-a4e1-f3e6307390e8 tempest-VolumesServicesTestJSON-167789424 None] Lock "cinder-b62241ed-21e9-4750-b7d0-2cbfe564948a-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:13 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-7b43032a-0708-402e-9151-9839b3f52c52" returned: 0 in 0.615s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] Lock "cinder-quobyte-7b43032a-0708-402e-9151-9839b3f52c52" released by "delete_volume" :: held 1.421s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:13 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] Created reservations ['8a54d6c0-3144-42fb-8b73-f813469fea5d'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:15:13 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] Created reservations ['d42a072f-94c8-4c9f-b357-5fd30562e305', '016b908d-92c2-4932-83f8-aa8acb0ddbbc', 'f2042395-4537-4689-988e-ef12ffb7854a', '92fcc06b-5fd1-4f4b-80f0-fdf0b9a6e259'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:15:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:15:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:15:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:13 devstack sudo[99816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:15:13 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:13 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.606s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:13 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:15:13 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-6eaf169c-72c6-4e70-a5db-bb3f1d9a6a1d tempest-GroupsV314Test-949338008 None] Delete group completed successfully.
Jun 06 01:15:23 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=70,cinder:UPDATE=85,cinder:DELETE=5,cinder:INSERT=19 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:15:23 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:INSERT=21,cinder:UPDATE=94,cinder:SELECT=67,cinder:DELETE=3 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:15:24 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:15:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Flow 'volume_create_manager' (e29910df-4b6b-4eb7-8dae-3b9e40571b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:15:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (435c9592-00b8-4363-a80e-9de7f62da00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (435c9592-00b8-4363-a80e-9de7f62da00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-436661902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3859a308-ef05-4d7e-8a37-8520e666c01d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b88c42078e74c63a87633b7758b1bd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:15:25Z,use_quota=True,user_id='8761b551c99d45c9b7ac18a50e92c861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29431246-6ed3-4cbd-8584-2eb04a2a2d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29431246-6ed3-4cbd-8584-2eb04a2a2d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74921f7f-5713-4051-8d62-5cd2c6358e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74921f7f-5713-4051-8d62-5cd2c6358e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3859a308-ef05-4d7e-8a37-8520e666c01d', 'volume_name': 'volume-3859a308-ef05-4d7e-8a37-8520e666c01d', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47e373e-302b-4a37-be9c-ba7e923c76d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47e373e-302b-4a37-be9c-ba7e923c76d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd868046-5e34-435d-a723-c44251e5dcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:25 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Volume 3859a308-ef05-4d7e-8a37-8520e666c01d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3859a308-ef05-4d7e-8a37-8520e666c01d', 'volume_size': 1}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-436661902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3859a308-ef05-4d7e-8a37-8520e666c01d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b88c42078e74c63a87633b7758b1bd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:15:25Z,use_quota=True,user_id='8761b551c99d45c9b7ac18a50e92c861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Creating volume 3859a308-ef05-4d7e-8a37-8520e666c01d {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:15:25 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:25 devstack sudo[99828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d 1073741824
Jun 06 01:15:25 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:25 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d 1073741824" returned: 0 in 0.812s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:25 devstack sudo[99834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d
Jun 06 01:15:25 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:26 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d" returned: 0 in 0.619s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:26 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:15:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:26 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd868046-5e34-435d-a723-c44251e5dcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3859a308-ef05-4d7e-8a37-8520e666c01d', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:26 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed27552-9df1-4ead-b330-a847d10d727a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:26 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Volume volume-3859a308-ef05-4d7e-8a37-8520e666c01d (3859a308-ef05-4d7e-8a37-8520e666c01d): created successfully
Jun 06 01:15:26 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed27552-9df1-4ead-b330-a847d10d727a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:26 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Flow 'volume_create_manager' (e29910df-4b6b-4eb7-8dae-3b9e40571b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:15:26 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-e741343f-b5ed-4fbb-9724-5b509ade207e tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Created volume successfully.
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Creating offline snapshot cfddfd00-736b-40a6-848f-be7612a44664 of volume 3859a308-ef05-4d7e-8a37-8520e666c01d {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[9137524a-b4f3-46ea-a47c-df3e992c6cbd]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Flow 'volume_create_manager' (012fba0f-12ae-4eff-9e7b-33ef4eb0a60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d558795-25f4-4c11-a17a-ea3a3ecc7975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d558795-25f4-4c11-a17a-ea3a3ecc7975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-430429374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8d42be-dece-443f-8b51-059c2e941be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8617403144f14435a2059b90fedf5876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:15:27Z,use_quota=True,user_id='f02a50e06646489d9bd8b31253df2552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8beb694-df64-4639-a50c-7ae1e38f4518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8beb694-df64-4639-a50c-7ae1e38f4518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b86e7b-958b-47de-83f2-92f1c7b2a9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG cinder.image.glance [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Creating Keystone auth plugin from conf {{(pid=86581) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 06 01:15:27 devstack sudo[99840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d
Jun 06 01:15:27 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b86e7b-958b-47de-83f2-92f1c7b2a9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2d8d42be-dece-443f-8b51-059c2e941be0', 'volume_name': 'volume-2d8d42be-dece-443f-8b51-059c2e941be0', 'volume_size': 1, 'image_id': '072119e4-dec9-4da3-882b-9b4b26824482', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30202bd94f9947968da8019925562da0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '072119e4-dec9-4da3-882b-9b4b26824482', 'created_at': datetime.datetime(2026, 6, 5, 22, 55, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 22, 55, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072119e4-dec9-4da3-882b-9b4b26824482/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x792698b4dc40>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a447d91d-2aff-4b21-86ee-e7b543b36aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a447d91d-2aff-4b21-86ee-e7b543b36aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af81edf-5e12-4b4f-9479-f11abef81dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:27 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Volume 2d8d42be-dece-443f-8b51-059c2e941be0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2d8d42be-dece-443f-8b51-059c2e941be0', 'volume_size': 1, 'image_id': '072119e4-dec9-4da3-882b-9b4b26824482', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30202bd94f9947968da8019925562da0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '072119e4-dec9-4da3-882b-9b4b26824482', 'created_at': datetime.datetime(2026, 6, 5, 22, 55, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 22, 55, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072119e4-dec9-4da3-882b-9b4b26824482/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x792698b4dc40>}
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Trying to clone 2d8d42be-dece-443f-8b51-059c2e941be0 from image 072119e4-dec9-4da3-882b-9b4b26824482 at location (None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}]). {{(pid=86581) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Jun 06 01:15:27 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_5b8se15hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jun 06 01:15:27 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Image download 20.69 MB at 20.69 MB/s
Jun 06 01:15:28 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[a999e504-4d71-4f67-8a6d-96166bbfa1fa]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_5b8se15hdevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:28 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d" returned: 0 in 0.756s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:28 devstack sudo[99847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664 1G
Jun 06 01:15:28 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:28 devstack sudo[99846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_5b8se15hdevstack@QuobyteHD
Jun 06 01:15:28 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:28 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_5b8se15hdevstack@QuobyteHD" returned: 0 in 0.689s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:28 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Temporary image 072119e4-dec9-4da3-882b-9b4b26824482 is fetched for user f02a50e06646489d9bd8b31253df2552. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jun 06 01:15:28 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[890e395f-ee2b-4c2b-8b15-5765076b9323]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_5b8se15hdevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:28 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664 1G" returned: 0 in 0.768s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3859a308-ef05-4d7e-8a37-8520e666c01d -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:28 devstack sudo[99857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3859a308-ef05-4d7e-8a37-8520e666c01d -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664
Jun 06 01:15:28 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:28 devstack sudo[99856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_5b8se15hdevstack@QuobyteHD
Jun 06 01:15:28 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:29 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:29 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_5b8se15hdevstack@QuobyteHD" returned: 0 in 0.695s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3859a308-ef05-4d7e-8a37-8520e666c01d -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664" returned: 0 in 0.675s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:29 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664 is being set with open permissions: ugo+rw
Jun 06 01:15:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:29 devstack sudo[99866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664
Jun 06 01:15:29 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:30 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664" returned: 0 in 0.583s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:30 devstack sudo[99869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.info
Jun 06 01:15:30 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:30 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.info" returned: 0 in 0.607s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:30 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.info is being set with open permissions: ugo+rw
Jun 06 01:15:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:30 devstack sudo[99872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.info
Jun 06 01:15:30 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:31 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.info" returned: 0 in 0.574s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.059s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.819s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-430429374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8d42be-dece-443f-8b51-059c2e941be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8617403144f14435a2059b90fedf5876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:15:27Z,use_quota=True,user_id='f02a50e06646489d9bd8b31253df2552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:15:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Creating volume 2d8d42be-dece-443f-8b51-059c2e941be0 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:15:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:15:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:15:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:15:31 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:15:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:31 devstack sudo[99875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0 1073741824
Jun 06 01:15:31 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:31 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-e6f4e4ac-cb37-4a93-bb92-01bb6f7c13b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Create snapshot completed successfully
Jun 06 01:15:32 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0 1073741824" returned: 0 in 0.745s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:32 devstack sudo[99880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0
Jun 06 01:15:32 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:32 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0" returned: 0 in 0.604s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Attempting download of 072119e4-dec9-4da3-882b-9b4b26824482 ((None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}])) to volume 2d8d42be-dece-443f-8b51-059c2e941be0. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9050cd-589e-4494-a11b-16083e08d6df]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_opfe1apw {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Acquiring lock "cinder-cfddfd00-736b-40a6-848f-be7612a44664-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "cinder-cfddfd00-736b-40a6-848f-be7612a44664-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Acquiring lock "cinder-quobyte-3859a308-ef05-4d7e-8a37-8520e666c01d" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "cinder-quobyte-3859a308-ef05-4d7e-8a37-8520e666c01d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Acquiring lock "cinder-quobyte-cfddfd00-736b-40a6-848f-be7612a44664" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "cinder-quobyte-cfddfd00-736b-40a6-848f-be7612a44664" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Deleting offline snapshot cfddfd00-736b-40a6-848f-be7612a44664 of volume 3859a308-ef05-4d7e-8a37-8520e666c01d {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:15:32 devstack sudo[99883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_opfe1apw
Jun 06 01:15:32 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] snapshot_file for this snap is: volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7d2015-83a0-4c9b-a2f2-eaa388817e29]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:33 devstack sudo[99885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664
Jun 06 01:15:33 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:33 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_opfe1apw" returned: 0 in 0.667s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_opfe1apw {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:33 devstack sudo[99890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_opfe1apw
Jun 06 01:15:33 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:33 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664" returned: 0 in 0.687s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:33 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3859a308-ef05-4d7e-8a37-8520e666c01d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:15:33 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95d53e2-6ddd-498c-9188-5a3afab77695]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:33 devstack sudo[99895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d
Jun 06 01:15:33 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:34 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_opfe1apw" returned: 1 in 0.675s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_opfe1apw' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:15:34 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ba0f20-9e3f-403a-8983-5f662ce7f157]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_5b8se15hdevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:34 devstack sudo[99899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_5b8se15hdevstack@QuobyteHD
Jun 06 01:15:34 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:34 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d" returned: 0 in 0.692s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:34 devstack sudo[99904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664
Jun 06 01:15:34 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:34 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_5b8se15hdevstack@QuobyteHD" returned: 0 in 0.688s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:34 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] 072119e4-dec9-4da3-882b-9b4b26824482 was qcow2, converting to raw {{(pid=86581) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jun 06 01:15:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_5b8se15hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:34 devstack sudo[99909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_5b8se15hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0
Jun 06 01:15:34 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:35 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664" returned: 0 in 0.689s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:35 devstack sudo[99914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664
Jun 06 01:15:35 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:35 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d.cfddfd00-736b-40a6-848f-be7612a44664" returned: 0 in 0.618s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:35 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "cinder-quobyte-cfddfd00-736b-40a6-848f-be7612a44664" released by "_delete_snapshot" :: held 2.804s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:35 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "cinder-quobyte-3859a308-ef05-4d7e-8a37-8520e666c01d" released by "delete_snapshot" :: held 2.826s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:35 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Created reservations ['62d1d444-9c85-4efb-9939-61633f23eea1', 'cd731143-5a58-44d5-af9b-2a216f2e6906', '01f88574-b923-4f7b-b938-5f93eb408a2c', '0ff7ec49-7438-459d-9c53-f0e1da963643'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:15:35 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Delete snapshot completed successfully.
Jun 06 01:15:35 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1cbd4d56-940d-4bfe-8cdc-d074b1781f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "cinder-cfddfd00-736b-40a6-848f-be7612a44664-delete_snapshot" released by "delete_snapshot" :: held 2.965s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:36 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Acquiring lock "cinder-3859a308-ef05-4d7e-8a37-8520e666c01d-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:36 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "cinder-3859a308-ef05-4d7e-8a37-8520e666c01d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:36 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Acquiring lock "cinder-quobyte-3859a308-ef05-4d7e-8a37-8520e666c01d" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:36 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "cinder-quobyte-3859a308-ef05-4d7e-8a37-8520e666c01d" acquired by "delete_volume" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:36 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a93c2e-862c-4d11-85cb-3d0bb556370d]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:36 devstack sudo[99926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d
Jun 06 01:15:36 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:36 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_5b8se15hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0" returned: 0 in 1.778s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:36 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_5b8se15hdevstack@QuobyteHD, size 112.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0 {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:15:36 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Converted 112.00 MB image at 62.93 MB/s
Jun 06 01:15:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:36 devstack sudo[99928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0 1G
Jun 06 01:15:36 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:36 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d" returned: 0 in 0.729s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:36 devstack sudo[99934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d
Jun 06 01:15:36 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:37 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0 1G" returned: 0 in 0.651s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:37 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[299b51e8-c800-4f76-a99a-d9d4ce302f05]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:37 devstack sudo[99939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0
Jun 06 01:15:37 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:37 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-3859a308-ef05-4d7e-8a37-8520e666c01d" returned: 0 in 0.613s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:37 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "cinder-quobyte-3859a308-ef05-4d7e-8a37-8520e666c01d" released by "delete_volume" :: held 1.414s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:37 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Created reservations ['889014fc-eb10-4073-85e3-31286d9f3a50', '50e697fe-54c7-440b-8d63-4b5b9e15ba37', 'b8739b01-7663-457c-82cf-09f70b2d7fa2', '76f1241c-95e5-46f8-995d-54a50e4123ae'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:15:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:15:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:15:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:37 devstack sudo[99942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:15:37 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:37 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0" returned: 0 in 0.683s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:38 devstack sudo[99946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0
Jun 06 01:15:38 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:38 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.608s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:38 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:15:38 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Deleted volume successfully.
Jun 06 01:15:38 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-685aaeca-2d3a-4466-8f80-b3ccf30b0299 tempest-VolumeSnapshotQuotasNegativeTestJSON-737739615 None] Lock "cinder-3859a308-ef05-4d7e-8a37-8520e666c01d-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:38 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0" returned: 1 in 0.716s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:15:38 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Downloaded image 072119e4-dec9-4da3-882b-9b4b26824482 ((None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}])) to volume 2d8d42be-dece-443f-8b51-059c2e941be0 successfully. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jun 06 01:15:38 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Temporary image 072119e4-dec9-4da3-882b-9b4b26824482 for user f02a50e06646489d9bd8b31253df2552 is deleted. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jun 06 01:15:38 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Marking volume 2d8d42be-dece-443f-8b51-059c2e941be0 as bootable. {{(pid=86581) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jun 06 01:15:38 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Copying metadata from image 072119e4-dec9-4da3-882b-9b4b26824482 to 2d8d42be-dece-443f-8b51-059c2e941be0. {{(pid=86581) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 06 01:15:38 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Creating volume glance metadata for volume 2d8d42be-dece-443f-8b51-059c2e941be0 backed by image 072119e4-dec9-4da3-882b-9b4b26824482 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '072119e4-dec9-4da3-882b-9b4b26824482', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86581) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 06 01:15:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af81edf-5e12-4b4f-9479-f11abef81dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d8d42be-dece-443f-8b51-059c2e941be0', 'volume_size': 1, 'image_id': '072119e4-dec9-4da3-882b-9b4b26824482', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30202bd94f9947968da8019925562da0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '072119e4-dec9-4da3-882b-9b4b26824482', 'created_at': datetime.datetime(2026, 6, 5, 22, 55, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 22, 55, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072119e4-dec9-4da3-882b-9b4b26824482/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x792698b4dc40>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e4ded8-33ac-459d-b767-a50416bd0a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:38 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Volume volume-2d8d42be-dece-443f-8b51-059c2e941be0 (2d8d42be-dece-443f-8b51-059c2e941be0): created successfully
Jun 06 01:15:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e4ded8-33ac-459d-b767-a50416bd0a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Flow 'volume_create_manager' (012fba0f-12ae-4eff-9e7b-33ef4eb0a60b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:15:38 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-cb667a8c-a7fc-4c07-9887-bdecc8d8999a tempest-VolumesImageMetadata-964380964 None] Created volume successfully.
Jun 06 01:15:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Acquiring lock "cinder-2d8d42be-dece-443f-8b51-059c2e941be0-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Lock "cinder-2d8d42be-dece-443f-8b51-059c2e941be0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Acquiring lock "cinder-quobyte-2d8d42be-dece-443f-8b51-059c2e941be0" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Lock "cinder-quobyte-2d8d42be-dece-443f-8b51-059c2e941be0" acquired by "delete_volume" :: waited 0.013s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:39 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2c07d1-988f-447f-9f82-144c796d610f]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:39 devstack sudo[99952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0
Jun 06 01:15:39 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:40 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0" returned: 0 in 0.718s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:40 devstack sudo[99956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0
Jun 06 01:15:40 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:41 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0" returned: 1 in 0.773s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:15:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:41 devstack sudo[99961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0
Jun 06 01:15:41 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:41 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2d8d42be-dece-443f-8b51-059c2e941be0" returned: 0 in 0.638s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Lock "cinder-quobyte-2d8d42be-dece-443f-8b51-059c2e941be0" released by "delete_volume" :: held 2.200s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:41 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Created reservations ['b5eb4ec9-745d-4f15-86a2-55ff4edbdec7', 'c8ec46a9-f055-4029-a39d-087341a37448', 'c2c75838-c21e-461f-8d6f-22fc612852e2', '7f14d574-23b0-439b-8931-3207cf85526d'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:15:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:15:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:15:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:41 devstack sudo[99964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:15:41 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:42 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.598s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:42 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:15:42 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Deleted volume successfully.
Jun 06 01:15:42 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-88be0412-6a07-4f52-9d64-2fb00908a9df tempest-VolumesImageMetadata-964380964 None] Lock "cinder-2d8d42be-dece-443f-8b51-059c2e941be0-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Flow 'volume_create_manager' (4d6f388f-d005-42b0-9ba2-48b221d720d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9727900a-d8a8-4fd9-94a6-aa72cdc0a615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9727900a-d8a8-4fd9-94a6-aa72cdc0a615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1452280972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd5331a-9fbf-4d95-85d8-5942a900dfc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b142af2a0ed4598903f2f99031ed409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:15:44Z,use_quota=True,user_id='dc6488303ccf4d61a5eda41cc2d4c29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6086b9b0-020b-47c9-830d-5a04cb4bc0a0),volume_type_id=6086b9b0-020b-47c9-830d-5a04cb4bc0a0)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00ec4e1-0dd6-47c7-890f-cba4dc12b4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00ec4e1-0dd6-47c7-890f-cba4dc12b4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff87972-8799-41cd-ac6e-2eae7624464a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff87972-8799-41cd-ac6e-2eae7624464a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd5331a-9fbf-4d95-85d8-5942a900dfc8', 'volume_name': 'volume-0fd5331a-9fbf-4d95-85d8-5942a900dfc8', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc366b59-4dd1-4bda-a127-2d933f652f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc366b59-4dd1-4bda-a127-2d933f652f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2a38c3-25b8-4fc5-a60e-e9760b36c80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:44 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Volume 0fd5331a-9fbf-4d95-85d8-5942a900dfc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd5331a-9fbf-4d95-85d8-5942a900dfc8', 'volume_size': 1}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1452280972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd5331a-9fbf-4d95-85d8-5942a900dfc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b142af2a0ed4598903f2f99031ed409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:15:44Z,use_quota=True,user_id='dc6488303ccf4d61a5eda41cc2d4c29b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6086b9b0-020b-47c9-830d-5a04cb4bc0a0),volume_type_id=6086b9b0-020b-47c9-830d-5a04cb4bc0a0)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Creating volume 0fd5331a-9fbf-4d95-85d8-5942a900dfc8 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:15:44 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0fd5331a-9fbf-4d95-85d8-5942a900dfc8 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:44 devstack sudo[99968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0fd5331a-9fbf-4d95-85d8-5942a900dfc8 1073741824
Jun 06 01:15:44 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:44 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0fd5331a-9fbf-4d95-85d8-5942a900dfc8 1073741824" returned: 0 in 0.821s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0fd5331a-9fbf-4d95-85d8-5942a900dfc8 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:45 devstack sudo[99974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0fd5331a-9fbf-4d95-85d8-5942a900dfc8
Jun 06 01:15:45 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:45 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0fd5331a-9fbf-4d95-85d8-5942a900dfc8" returned: 0 in 0.608s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:15:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2a38c3-25b8-4fc5-a60e-e9760b36c80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd5331a-9fbf-4d95-85d8-5942a900dfc8', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff921a6-a067-4eba-8061-d7f45e861bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:45 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Volume volume-0fd5331a-9fbf-4d95-85d8-5942a900dfc8 (0fd5331a-9fbf-4d95-85d8-5942a900dfc8): created successfully
Jun 06 01:15:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff921a6-a067-4eba-8061-d7f45e861bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Flow 'volume_create_manager' (4d6f388f-d005-42b0-9ba2-48b221d720d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:15:45 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-2335886c-021b-4b6f-9dc3-b0560a93a9ad tempest-VolumeTypesAccessTest-840404425 None] Created volume successfully.
Jun 06 01:15:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Acquiring lock "cinder-0fd5331a-9fbf-4d95-85d8-5942a900dfc8-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Lock "cinder-0fd5331a-9fbf-4d95-85d8-5942a900dfc8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Acquiring lock "cinder-quobyte-0fd5331a-9fbf-4d95-85d8-5942a900dfc8" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Lock "cinder-quobyte-0fd5331a-9fbf-4d95-85d8-5942a900dfc8" acquired by "delete_volume" :: waited 0.026s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:46 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[761b9052-1a9c-40fd-b1cc-fa3934fc990a]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0fd5331a-9fbf-4d95-85d8-5942a900dfc8 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:46 devstack sudo[99977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0fd5331a-9fbf-4d95-85d8-5942a900dfc8
Jun 06 01:15:46 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:47 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0fd5331a-9fbf-4d95-85d8-5942a900dfc8" returned: 0 in 0.728s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0fd5331a-9fbf-4d95-85d8-5942a900dfc8 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:47 devstack sudo[99982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0fd5331a-9fbf-4d95-85d8-5942a900dfc8
Jun 06 01:15:47 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:47 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0fd5331a-9fbf-4d95-85d8-5942a900dfc8" returned: 0 in 0.602s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:47 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Lock "cinder-quobyte-0fd5331a-9fbf-4d95-85d8-5942a900dfc8" released by "delete_volume" :: held 1.379s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:47 devstack cinder-volume[86581]: WARNING cinder.quota [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1769568215 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1769568215, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:15:47 devstack cinder-volume[86581]: WARNING cinder.quota [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1769568215 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1769568215, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:15:47 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Created reservations ['a2118173-ae59-4d35-83f9-04038d6c2304', '2d04dd3c-67aa-4ae8-bc62-891c86db13dd', 'a06900f7-e534-482b-b876-b48dda575f3d', '15ddab04-4881-4ab7-8f26-c9be4dcf3a6d'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:15:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:15:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:15:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:47 devstack sudo[99985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:15:47 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:48 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.593s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:48 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:15:48 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Deleted volume successfully.
Jun 06 01:15:48 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7899af05-9f03-443e-96f3-5c094a8990e5 tempest-VolumeTypesAccessTest-840404425 None] Lock "cinder-0fd5331a-9fbf-4d95-85d8-5942a900dfc8-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Flow 'volume_create_manager' (729fed5d-58eb-41b1-8896-18a9c76dbc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ad5767-131a-4fa1-94eb-f0668136f137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ad5767-131a-4fa1-94eb-f0668136f137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-103515233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='242d51b79dcb437ca0036f22316d37fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:15:49Z,use_quota=True,user_id='7bc63f71a89c4e47b5f7aaae273e8289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760ff0c2-202d-4fb6-b641-0b05440f295a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760ff0c2-202d-4fb6-b641-0b05440f295a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcaf9aec-e927-45a1-9218-dcd35c6c5a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcaf9aec-e927-45a1-9218-dcd35c6c5a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7', 'volume_name': 'volume-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23d636d-1142-40d6-becf-95957c0ff50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23d636d-1142-40d6-becf-95957c0ff50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e42535b-3af8-4357-b3b3-08aa49cc12bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:49 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Volume 84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7', 'volume_size': 1}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-103515233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='242d51b79dcb437ca0036f22316d37fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:15:49Z,use_quota=True,user_id='7bc63f71a89c4e47b5f7aaae273e8289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Creating volume 84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:15:49 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:15:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:49 devstack sudo[99988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7 1073741824
Jun 06 01:15:49 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:50 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7 1073741824" returned: 0 in 0.816s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:50 devstack sudo[99994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7
Jun 06 01:15:50 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:50 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7" returned: 0 in 0.633s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:15:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e42535b-3af8-4357-b3b3-08aa49cc12bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb92a6f0-ab0a-4f4e-acc0-2a42623a9714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:50 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Volume volume-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7 (84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7): created successfully
Jun 06 01:15:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb92a6f0-ab0a-4f4e-acc0-2a42623a9714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Flow 'volume_create_manager' (729fed5d-58eb-41b1-8896-18a9c76dbc9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:15:50 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-0ba7b612-4c68-4b59-aebe-ad8ba1d2b340 tempest-VolumesTransfersTest-547936809 None] Created volume successfully.
Jun 06 01:15:52 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-775747bb-d725-4f3c-826b-b77a21511cc5 tempest-VolumesTransfersTest-825720161 None] Transfer volume completed successfully.
Jun 06 01:15:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] Acquiring lock "cinder-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] Lock "cinder-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] Acquiring lock "cinder-quobyte-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] Lock "cinder-quobyte-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7" acquired by "delete_volume" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:53 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f17a99-d479-438d-99e4-0a16e4692102]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:53 devstack sudo[99998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7
Jun 06 01:15:53 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:54 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7" returned: 0 in 0.744s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:54 devstack sudo[100003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7
Jun 06 01:15:54 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:54 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7" returned: 0 in 0.600s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] Lock "cinder-quobyte-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7" released by "delete_volume" :: held 1.387s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:54 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] Created reservations ['3949b9bb-6eae-4469-972d-d286423c342f', 'd18583c1-b08d-45a0-a14e-90a94971e286', 'e37ecc72-2002-4014-81cf-f24d921d4b02', 'de8cf9e2-6434-47be-9023-f52346eaf993'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:15:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:15:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:15:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:54 devstack sudo[100006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:15:54 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:55 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.595s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:55 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:15:55 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] Deleted volume successfully.
Jun 06 01:15:55 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5efe53cc-553b-42b0-b512-4900e4666831 tempest-VolumesTransfersTest-868521295 None] Lock "cinder-84d6ee23-78ad-49cf-ae6b-0fb3d1e9edf7-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Flow 'volume_create_manager' (58c86bcd-3580-4d7f-aa5a-ff7a91993bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a5d91a-bbef-42cc-9014-a1248c8b2050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a5d91a-bbef-42cc-9014-a1248c8b2050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-950393859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f554a7-1338-4503-b0f7-c2f2a71a8476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='242d51b79dcb437ca0036f22316d37fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:15:56Z,use_quota=True,user_id='7bc63f71a89c4e47b5f7aaae273e8289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae3ea5e-d02a-4453-9f8f-3d7e350907ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae3ea5e-d02a-4453-9f8f-3d7e350907ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a890d77-028c-4640-aaca-06ad0b2b828e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a890d77-028c-4640-aaca-06ad0b2b828e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38f554a7-1338-4503-b0f7-c2f2a71a8476', 'volume_name': 'volume-38f554a7-1338-4503-b0f7-c2f2a71a8476', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6c416e-e42a-4758-af28-f82499bcc75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6c416e-e42a-4758-af28-f82499bcc75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1c150e-21f7-4cc2-b18f-8b078442b720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:56 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Volume 38f554a7-1338-4503-b0f7-c2f2a71a8476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38f554a7-1338-4503-b0f7-c2f2a71a8476', 'volume_size': 1}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-950393859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f554a7-1338-4503-b0f7-c2f2a71a8476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='242d51b79dcb437ca0036f22316d37fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:15:56Z,use_quota=True,user_id='7bc63f71a89c4e47b5f7aaae273e8289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Creating volume 38f554a7-1338-4503-b0f7-c2f2a71a8476 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:15:56 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:15:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38f554a7-1338-4503-b0f7-c2f2a71a8476 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:56 devstack sudo[100009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38f554a7-1338-4503-b0f7-c2f2a71a8476 1073741824
Jun 06 01:15:56 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:56 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38f554a7-1338-4503-b0f7-c2f2a71a8476 1073741824" returned: 0 in 0.849s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38f554a7-1338-4503-b0f7-c2f2a71a8476 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:57 devstack sudo[100015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38f554a7-1338-4503-b0f7-c2f2a71a8476
Jun 06 01:15:57 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:57 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38f554a7-1338-4503-b0f7-c2f2a71a8476" returned: 0 in 0.601s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:15:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1c150e-21f7-4cc2-b18f-8b078442b720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f554a7-1338-4503-b0f7-c2f2a71a8476', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f927d4-f880-4fe0-ba3b-5dee79c5e6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:15:57 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Volume volume-38f554a7-1338-4503-b0f7-c2f2a71a8476 (38f554a7-1338-4503-b0f7-c2f2a71a8476): created successfully
Jun 06 01:15:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f927d4-f880-4fe0-ba3b-5dee79c5e6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:15:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Flow 'volume_create_manager' (58c86bcd-3580-4d7f-aa5a-ff7a91993bed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:15:57 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f65b7c98-5e2a-4fe9-9db1-0ed6f6cbd715 tempest-VolumesTransfersTest-547936809 None] Created volume successfully.
Jun 06 01:15:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] Acquiring lock "cinder-38f554a7-1338-4503-b0f7-c2f2a71a8476-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] Lock "cinder-38f554a7-1338-4503-b0f7-c2f2a71a8476-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] Acquiring lock "cinder-quobyte-38f554a7-1338-4503-b0f7-c2f2a71a8476" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:15:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] Lock "cinder-quobyte-38f554a7-1338-4503-b0f7-c2f2a71a8476" acquired by "delete_volume" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:15:58 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb58876d-cc75-43f8-8ea9-e682fb813fb8]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:15:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38f554a7-1338-4503-b0f7-c2f2a71a8476 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:58 devstack sudo[100018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38f554a7-1338-4503-b0f7-c2f2a71a8476
Jun 06 01:15:58 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:59 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38f554a7-1338-4503-b0f7-c2f2a71a8476" returned: 0 in 0.737s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38f554a7-1338-4503-b0f7-c2f2a71a8476 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:59 devstack sudo[100023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38f554a7-1338-4503-b0f7-c2f2a71a8476
Jun 06 01:15:59 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:15:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:15:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:15:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:15:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:15:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:15:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:15:59 devstack sudo[100025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:15:59 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:15:59 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-38f554a7-1338-4503-b0f7-c2f2a71a8476" returned: 0 in 0.625s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] Lock "cinder-quobyte-38f554a7-1338-4503-b0f7-c2f2a71a8476" released by "delete_volume" :: held 1.410s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:15:59 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] Created reservations ['f6687adc-b3ba-48ce-9302-114e0e8e3bbc', 'c3bb2884-b8dc-4e08-bdf9-61d50ffa4640', '3c0669b2-f3be-44e9-8328-07ea6c37c5ab', '7f45f3c0-4bea-4e4b-a0f0-0a4236555f9e'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:15:59 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root
Jun 06 01:15:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.658s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:15:59 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:16:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:16:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:16:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:00 devstack sudo[100029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:16:00 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:00 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.620s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:16:00 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] Deleted volume successfully.
Jun 06 01:16:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-37c9cd07-6e9b-4d98-b502-834e2a6372c6 tempest-VolumesTransfersTest-868521295 None] Lock "cinder-38f554a7-1338-4503-b0f7-c2f2a71a8476-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Flow 'volume_create_manager' (4b49ab97-c350-4a26-9411-43b085a3e0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565ab19f-2e46-450e-8453-037ac4e7b35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565ab19f-2e46-450e-8453-037ac4e7b35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1588198790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdbecb9-28b3-4ff4-9166-793119675a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b7b4b26e0f4291aadab276ce3b7b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:16:04Z,use_quota=True,user_id='93d53326dd7a42f1bf6602cd29cf845a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6394d105-e5b9-41b5-bd2a-de3056e1f886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6394d105-e5b9-41b5-bd2a-de3056e1f886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b2f352-7b0e-4162-8dff-4484445ccf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b2f352-7b0e-4162-8dff-4484445ccf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bdbecb9-28b3-4ff4-9166-793119675a3d', 'volume_name': 'volume-6bdbecb9-28b3-4ff4-9166-793119675a3d', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc92bcb8-4703-4385-bfff-cb29fc918e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc92bcb8-4703-4385-bfff-cb29fc918e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352af453-af34-40cf-a118-949b4e4388ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:03 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Volume 6bdbecb9-28b3-4ff4-9166-793119675a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bdbecb9-28b3-4ff4-9166-793119675a3d', 'volume_size': 1}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1588198790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdbecb9-28b3-4ff4-9166-793119675a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b7b4b26e0f4291aadab276ce3b7b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:16:04Z,use_quota=True,user_id='93d53326dd7a42f1bf6602cd29cf845a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Creating volume 6bdbecb9-28b3-4ff4-9166-793119675a3d {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:16:03 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:16:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:03 devstack sudo[100033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d 1073741824
Jun 06 01:16:03 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:04 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d 1073741824" returned: 0 in 0.833s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:04 devstack sudo[100039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d
Jun 06 01:16:04 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:05 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d" returned: 0 in 0.620s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352af453-af34-40cf-a118-949b4e4388ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bdbecb9-28b3-4ff4-9166-793119675a3d', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ca0290-b063-416d-a935-ccf24397dbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:05 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Volume volume-6bdbecb9-28b3-4ff4-9166-793119675a3d (6bdbecb9-28b3-4ff4-9166-793119675a3d): created successfully
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ca0290-b063-416d-a935-ccf24397dbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Flow 'volume_create_manager' (4b49ab97-c350-4a26-9411-43b085a3e0ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:16:05 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-a7fb2c26-a8d6-42e4-b2b4-1f60dca78aad tempest-SnapshotMetadataTestJSON-489098371 None] Created volume successfully.
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Flow 'volume_create_manager' (240b1ee2-f3a2-4440-a29a-addb40a55fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a75058-55d6-44ec-bbfb-23a238db4a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a75058-55d6-44ec-bbfb-23a238db4a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1950752507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22274883-e77e-46de-9877-35a9bada24fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23789d35d754ba88423d507f1579b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:16:06Z,use_quota=True,user_id='36990610933a4312b1858257aa17a12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea592298-6f83-487d-856f-6fb40ec0f112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea592298-6f83-487d-856f-6fb40ec0f112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439fe292-3d42-48ce-8885-03d0b6680a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439fe292-3d42-48ce-8885-03d0b6680a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22274883-e77e-46de-9877-35a9bada24fe', 'volume_name': 'volume-22274883-e77e-46de-9877-35a9bada24fe', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb9f971-7641-4d6a-ac2a-a74d63454f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb9f971-7641-4d6a-ac2a-a74d63454f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cffb206f-4d5e-4e0b-82c6-4d4c674c9fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:05 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Volume 22274883-e77e-46de-9877-35a9bada24fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22274883-e77e-46de-9877-35a9bada24fe', 'volume_size': 1}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1950752507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22274883-e77e-46de-9877-35a9bada24fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23789d35d754ba88423d507f1579b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:16:06Z,use_quota=True,user_id='36990610933a4312b1858257aa17a12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Creating volume 22274883-e77e-46de-9877-35a9bada24fe {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:16:05 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:16:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:05 devstack sudo[100042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe 1073741824
Jun 06 01:16:05 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:06 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe 1073741824" returned: 0 in 0.750s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:06 devstack sudo[100047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe
Jun 06 01:16:06 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:07 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe" returned: 0 in 0.587s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:16:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.098s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cffb206f-4d5e-4e0b-82c6-4d4c674c9fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22274883-e77e-46de-9877-35a9bada24fe', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15728cd4-c461-48d1-a85e-c778c60b0415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] Creating offline snapshot 75430144-4ead-40dc-bca5-a38a018911c2 of volume 6bdbecb9-28b3-4ff4-9166-793119675a3d {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:16:07 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb3f4de-e7fc-468d-b35b-9b4f463e8aae]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:07 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Volume volume-22274883-e77e-46de-9877-35a9bada24fe (22274883-e77e-46de-9877-35a9bada24fe): created successfully
Jun 06 01:16:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15728cd4-c461-48d1-a85e-c778c60b0415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Flow 'volume_create_manager' (240b1ee2-f3a2-4440-a29a-addb40a55fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:16:07 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-0af240b3-8ffe-49eb-bb8d-b9ae0d3a01f9 tempest-VolumesCloneTest-1318742039 None] Created volume successfully.
Jun 06 01:16:07 devstack sudo[100050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d
Jun 06 01:16:07 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:07 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d" returned: 0 in 0.697s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:07 devstack sudo[100055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2 1G
Jun 06 01:16:07 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:08 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:16:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Flow 'volume_create_manager' (912353cb-bdff-446c-9d66-f79337544b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:16:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4870fb95-505e-434a-aeab-2d307ae5eee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4870fb95-505e-434a-aeab-2d307ae5eee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-113221313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe69ab3d-fbd3-4df2-b7bd-5bd69351b931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23789d35d754ba88423d507f1579b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:16:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=22274883-e77e-46de-9877-35a9bada24fe,status='creating',terminated_at=None,updated_at=2026-06-05T23:16:08Z,use_quota=True,user_id='36990610933a4312b1858257aa17a12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e12d637-efb9-4156-8e12-82412cb1e8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e12d637-efb9-4156-8e12-82412cb1e8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c11b264-3382-4bdb-9bf6-bddf1d1e7282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c11b264-3382-4bdb-9bf6-bddf1d1e7282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fe69ab3d-fbd3-4df2-b7bd-5bd69351b931', 'volume_name': 'volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931', 'volume_size': 2, 'source_volid': '22274883-e77e-46de-9877-35a9bada24fe', 'source_volstatus': 'available'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7fe830-0cbc-4e83-a802-f4de69e710a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7fe830-0cbc-4e83-a802-f4de69e710a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06b0d18-d302-4211-ab36-e2b9deeedb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:08 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Volume fe69ab3d-fbd3-4df2-b7bd-5bd69351b931: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931', 'volume_size': 2, 'source_volid': '22274883-e77e-46de-9877-35a9bada24fe', 'source_volstatus': 'available'}
Jun 06 01:16:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:08 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2 1G" returned: 0 in 0.733s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bdbecb9-28b3-4ff4-9166-793119675a3d -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:08 devstack sudo[100061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bdbecb9-28b3-4ff4-9166-793119675a3d -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2
Jun 06 01:16:08 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:09 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bdbecb9-28b3-4ff4-9166-793119675a3d -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2" returned: 0 in 0.639s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:09 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2 is being set with open permissions: ugo+rw
Jun 06 01:16:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:09 devstack sudo[100066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2
Jun 06 01:16:09 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:09 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2" returned: 0 in 0.581s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:09 devstack sudo[100069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.info
Jun 06 01:16:09 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:10 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.info" returned: 0 in 0.594s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:10 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.info is being set with open permissions: ugo+rw
Jun 06 01:16:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:10 devstack sudo[100072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.info
Jun 06 01:16:10 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:11 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.info" returned: 0 in 0.575s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.920s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.720s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:11 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Cloning volume 22274883-e77e-46de-9877-35a9bada24fe to volume fe69ab3d-fbd3-4df2-b7bd-5bd69351b931
Jun 06 01:16:11 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-a4119a86-9bfd-4472-bce0-b3d65e28053c tempest-SnapshotMetadataTestJSON-489098371 None] Create snapshot completed successfully
Jun 06 01:16:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Creating offline snapshot 4f521c95-ea76-4fdb-b112-22f2f1952e6f of volume 22274883-e77e-46de-9877-35a9bada24fe {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:16:11 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd80f106-396e-4a2a-affc-6432042cb60e]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:11 devstack sudo[100075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe
Jun 06 01:16:11 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:11 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe" returned: 0 in 0.724s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:11 devstack sudo[100080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f 1G
Jun 06 01:16:11 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:11 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] Acquiring lock "cinder-75430144-4ead-40dc-bca5-a38a018911c2-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:11 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] Lock "cinder-75430144-4ead-40dc-bca5-a38a018911c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:11 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] Acquiring lock "cinder-quobyte-6bdbecb9-28b3-4ff4-9166-793119675a3d" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:11 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] Lock "cinder-quobyte-6bdbecb9-28b3-4ff4-9166-793119675a3d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:11 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] Acquiring lock "cinder-quobyte-75430144-4ead-40dc-bca5-a38a018911c2" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] Lock "cinder-quobyte-75430144-4ead-40dc-bca5-a38a018911c2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] Deleting offline snapshot 75430144-4ead-40dc-bca5-a38a018911c2 of volume 6bdbecb9-28b3-4ff4-9166-793119675a3d {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:16:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] snapshot_file for this snap is: volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:16:12 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd398c6-2ac4-4a57-ad4a-28a52d69ff9f]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:12 devstack sudo[100082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2
Jun 06 01:16:12 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:12 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f 1G" returned: 0 in 0.814s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22274883-e77e-46de-9877-35a9bada24fe -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:12 devstack sudo[100123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22274883-e77e-46de-9877-35a9bada24fe -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f
Jun 06 01:16:12 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:12 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2" returned: 0 in 0.749s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bdbecb9-28b3-4ff4-9166-793119675a3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:16:12 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd245bd-844a-4d39-bf7f-1c0637ec79ee]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:12 devstack sudo[100128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d
Jun 06 01:16:12 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:13 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22274883-e77e-46de-9877-35a9bada24fe -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f" returned: 0 in 0.677s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:13 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f is being set with open permissions: ugo+rw
Jun 06 01:16:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:13 devstack sudo[100134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f
Jun 06 01:16:13 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:13 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d" returned: 0 in 0.730s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:13 devstack sudo[100139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2
Jun 06 01:16:13 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:13 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f" returned: 0 in 0.592s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:13 devstack sudo[100142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.info
Jun 06 01:16:13 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:14 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2" returned: 0 in 0.678s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:14 devstack sudo[100147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2
Jun 06 01:16:14 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:14 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.info" returned: 0 in 0.626s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:14 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.info is being set with open permissions: ugo+rw
Jun 06 01:16:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:14 devstack sudo[100150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.info
Jun 06 01:16:14 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:14 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d.75430144-4ead-40dc-bca5-a38a018911c2" returned: 0 in 0.579s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] Lock "cinder-quobyte-75430144-4ead-40dc-bca5-a38a018911c2" released by "_delete_snapshot" :: held 2.850s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] Lock "cinder-quobyte-6bdbecb9-28b3-4ff4-9166-793119675a3d" released by "delete_snapshot" :: held 2.880s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:14 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] Created reservations ['39016104-2d1f-4ab9-a2c3-fe042551ff20', '9ec0f3b5-44de-4b3d-b7b0-78f4b112c24b', '6f84d57d-10d2-401e-bfe7-11df1a78dfda', '4af59a9f-6d36-4e33-938e-ca3d8a884d84'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:16:14 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] Delete snapshot completed successfully.
Jun 06 01:16:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-56af1563-395f-4426-944b-c1a9b359506c tempest-SnapshotMetadataTestJSON-489098371 None] Lock "cinder-75430144-4ead-40dc-bca5-a38a018911c2-delete_snapshot" released by "delete_snapshot" :: held 3.022s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] Acquiring lock "cinder-6bdbecb9-28b3-4ff4-9166-793119675a3d-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] Lock "cinder-6bdbecb9-28b3-4ff4-9166-793119675a3d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:15 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.info" returned: 0 in 0.640s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Acquiring lock "cinder-quobyte-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931" by "_copy_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Lock "cinder-quobyte-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] snapshot: 4f521c95-ea76-4fdb-b112-22f2f1952e6f, volume: fe69ab3d-fbd3-4df2-b7bd-5bd69351b931,  {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 06 01:16:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:16:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:16:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:15 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b78d4d7-72f2-45a7-9069-476af8872515]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] Acquiring lock "cinder-quobyte-6bdbecb9-28b3-4ff4-9166-793119675a3d" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] Lock "cinder-quobyte-6bdbecb9-28b3-4ff4-9166-793119675a3d" acquired by "delete_volume" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:15 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[426961cf-6c4a-4ee4-b955-90b1285afbfd]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:15 devstack sudo[100154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f
Jun 06 01:16:15 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:15 devstack sudo[100155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d
Jun 06 01:16:15 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:16 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f" returned: 0 in 0.707s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22274883-e77e-46de-9877-35a9bada24fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Creating direct copy from snapshot {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abe7e71-ea47-42cd-bf00-a2f66e0b8d30]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:16 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d" returned: 0 in 0.700s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:16 devstack sudo[100165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d
Jun 06 01:16:16 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:16 devstack sudo[100164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe
Jun 06 01:16:16 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:16 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6bdbecb9-28b3-4ff4-9166-793119675a3d" returned: 0 in 0.608s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] Lock "cinder-quobyte-6bdbecb9-28b3-4ff4-9166-793119675a3d" released by "delete_volume" :: held 1.367s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:16 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe" returned: 0 in 0.719s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG cinder.utils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Path /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931 not found in is_blk_device check {{(pid=86581) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] Created reservations ['3f1f103c-8b8d-4a3e-8f02-10b3a6366124', '803b9c87-6b49-4762-b24b-5af0ff34afb5', '6b4065d9-17ea-4dda-a96b-dfde856bb8df', '1c45be52-ee02-4c38-946a-e05e766e58de'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:16:16 devstack sudo[100178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931
Jun 06 01:16:16 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:16 devstack sudo[100180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:16:16 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:17 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.597s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:17 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:16:17 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] Deleted volume successfully.
Jun 06 01:16:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a9470e3c-3f00-48e6-a481-947cc10d506c tempest-SnapshotMetadataTestJSON-489098371 None] Lock "cinder-6bdbecb9-28b3-4ff4-9166-793119675a3d-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:21 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931" returned: 0 in 5.064s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:21 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0e9b3e-fc07-41cf-b8b5-fb7be615a180]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:21 devstack sudo[100194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe
Jun 06 01:16:21 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:22 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe" returned: 0 in 0.870s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:22 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Image conversion details: src /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe, size 1024.00 MB, duration 5.06 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931 {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:16:22 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Converted 1024.00 MB image at 202.19 MB/s
Jun 06 01:16:22 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931 is being set with open permissions: ugo+rw
Jun 06 01:16:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:22 devstack sudo[100199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931
Jun 06 01:16:22 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Flow 'volume_create_manager' (3839d571-adca-41be-9a6f-d3283062b2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1044f9-2db2-430e-8773-bf1693b391c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1044f9-2db2-430e-8773-bf1693b391c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1914577377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e18c58b-cf33-40a0-b0ac-3e67475f5fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ee8ac0cdfda4e79823fca078eca9602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:16:23Z,use_quota=True,user_id='3209669753d9404ebcf6d99956d4bcba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07c7c56-a4a6-42e8-9f82-3e357214e781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07c7c56-a4a6-42e8-9f82-3e357214e781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ff1f7e-2938-4259-8e09-534740b4dd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ff1f7e-2938-4259-8e09-534740b4dd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e18c58b-cf33-40a0-b0ac-3e67475f5fbf', 'volume_name': 'volume-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccfcddad-4a3c-4a5f-b457-6b73a7b00565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccfcddad-4a3c-4a5f-b457-6b73a7b00565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f7d740-5404-45f2-a06c-7d184baeef29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:23 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Volume 5e18c58b-cf33-40a0-b0ac-3e67475f5fbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf', 'volume_size': 1}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:23 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931" returned: 0 in 0.585s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Lock "cinder-quobyte-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931" released by "_copy_volume_from_snapshot" :: held 8.027s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=85,cinder:INSERT=28,cinder:DELETE=11,cinder:SELECT=71 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Acquiring lock "cinder-quobyte-4f521c95-ea76-4fdb-b112-22f2f1952e6f" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Lock "cinder-quobyte-4f521c95-ea76-4fdb-b112-22f2f1952e6f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Deleting offline snapshot 4f521c95-ea76-4fdb-b112-22f2f1952e6f of volume 22274883-e77e-46de-9877-35a9bada24fe {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] snapshot_file for this snap is: volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[263b8aec-aaf7-4f2d-a38a-e7171f73c6c6]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:23 devstack sudo[100204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f
Jun 06 01:16:23 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:24 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f" returned: 0 in 0.736s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22274883-e77e-46de-9877-35a9bada24fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:16:24 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b807710c-b63b-4d9e-9794-f44b8bb16c7f]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:24 devstack sudo[100209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe
Jun 06 01:16:24 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:24 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe" returned: 0 in 0.690s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:24 devstack sudo[100214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f
Jun 06 01:16:24 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:25 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f" returned: 0 in 0.663s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:25 devstack sudo[100219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f
Jun 06 01:16:25 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:26 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe.4f521c95-ea76-4fdb-b112-22f2f1952e6f" returned: 0 in 0.574s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Lock "cinder-quobyte-4f521c95-ea76-4fdb-b112-22f2f1952e6f" released by "_delete_snapshot" :: held 2.749s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=79,cinder:UPDATE=89,cinder:INSERT=28,cinder:DELETE=4 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.040s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.919s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1914577377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e18c58b-cf33-40a0-b0ac-3e67475f5fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ee8ac0cdfda4e79823fca078eca9602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:16:23Z,use_quota=True,user_id='3209669753d9404ebcf6d99956d4bcba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Creating volume 5e18c58b-cf33-40a0-b0ac-3e67475f5fbf {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:16:26 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:26 devstack sudo[100224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf 1073741824
Jun 06 01:16:26 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06b0d18-d302-4211-ab36-e2b9deeedb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931', 'volume_size': 2, 'source_volid': '22274883-e77e-46de-9877-35a9bada24fe', 'source_volstatus': 'available'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a124fcb-fc4e-4107-b649-7cf567974699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:26 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Volume volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931 (fe69ab3d-fbd3-4df2-b7bd-5bd69351b931): created successfully
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a124fcb-fc4e-4107-b649-7cf567974699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Flow 'volume_create_manager' (912353cb-bdff-446c-9d66-f79337544b5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:16:26 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-74bf0f9a-42b9-403e-9ad9-d8a763726745 tempest-VolumesCloneTest-1318742039 None] Created volume successfully.
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] Acquiring lock "cinder-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] Lock "cinder-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] Acquiring lock "cinder-quobyte-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] Lock "cinder-quobyte-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931" acquired by "delete_volume" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd60b90-6313-4001-954e-87421e1ead6f]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:26 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf 1073741824" returned: 0 in 0.803s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:26 devstack sudo[100231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf
Jun 06 01:16:26 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:26 devstack sudo[100230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931
Jun 06 01:16:26 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:27 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf" returned: 0 in 0.578s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:16:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f7d740-5404-45f2-a06c-7d184baeef29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d40324-dcae-4950-95e2-5c1ec6537752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:27 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Volume volume-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf (5e18c58b-cf33-40a0-b0ac-3e67475f5fbf): created successfully
Jun 06 01:16:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d40324-dcae-4950-95e2-5c1ec6537752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Flow 'volume_create_manager' (3839d571-adca-41be-9a6f-d3283062b2e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:16:27 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-cd9cf5e4-ecbd-4cec-ad60-03fe17e00110 tempest-AbsoluteLimitsTests-1534325527 None] Created volume successfully.
Jun 06 01:16:27 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931" returned: 0 in 0.728s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:27 devstack sudo[100238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931
Jun 06 01:16:27 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:28 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931" returned: 0 in 0.583s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] Lock "cinder-quobyte-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931" released by "delete_volume" :: held 1.348s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] Created reservations ['65fe73b1-87a7-4ba5-bf54-c49ea2c8e532', '21511b73-93b0-495c-86ee-cea8f835ab35', '52bfbda2-66f9-425f-89bc-4da14df5884c', 'bb295f05-fd78-459a-9ed0-5c02cad22b0a'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:28 devstack sudo[100241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:16:28 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] Acquiring lock "cinder-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] Lock "cinder-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] Acquiring lock "cinder-quobyte-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] Lock "cinder-quobyte-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf" acquired by "delete_volume" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ce239c-1bc6-4b6c-8dc9-7ffb51d084ad]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:28 devstack sudo[100243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf
Jun 06 01:16:28 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:28 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.611s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:16:28 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] Deleted volume successfully.
Jun 06 01:16:28 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-1793c614-f263-406b-acc5-3c3bfffb46ad tempest-VolumesCloneTest-1318742039 None] Lock "cinder-fe69ab3d-fbd3-4df2-b7bd-5bd69351b931-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] Acquiring lock "cinder-22274883-e77e-46de-9877-35a9bada24fe-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] Lock "cinder-22274883-e77e-46de-9877-35a9bada24fe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] Acquiring lock "cinder-quobyte-22274883-e77e-46de-9877-35a9bada24fe" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] Lock "cinder-quobyte-22274883-e77e-46de-9877-35a9bada24fe" acquired by "delete_volume" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:29 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b585bc-68d8-4ca6-8c57-58e98f6003ec]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:29 devstack sudo[100246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe
Jun 06 01:16:29 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:29 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf" returned: 0 in 0.712s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:29 devstack sudo[100251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf
Jun 06 01:16:29 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:29 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe" returned: 0 in 0.712s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:29 devstack sudo[100257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe
Jun 06 01:16:29 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:29 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf" returned: 0 in 0.580s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] Lock "cinder-quobyte-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf" released by "delete_volume" :: held 1.335s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] Created reservations ['dc7de36b-f87c-4bf7-b7f4-ee6538dff7b0', 'd03cf47d-50ee-46a9-b1f4-67b647272cc2', '12780bb3-579d-4ee4-94df-b8240690ba16', '55119705-05dd-4404-b46d-2d42ff558f79'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:30 devstack sudo[100259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:16:30 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:30 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22274883-e77e-46de-9877-35a9bada24fe" returned: 0 in 0.599s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] Lock "cinder-quobyte-22274883-e77e-46de-9877-35a9bada24fe" released by "delete_volume" :: held 1.374s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] Created reservations ['32c440b7-bb2e-4a95-a991-3bdd828511c7', '74b95838-f3a1-485e-94b9-21794c474a13', '2f2bf21d-631d-4151-8501-bc20edf871c4', 'ff0646b6-c353-4816-a0a8-fa866a5f59ec'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:30 devstack sudo[100263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:16:30 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:30 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.596s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:16:30 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] Deleted volume successfully.
Jun 06 01:16:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-093f435a-c6de-4b19-b3b8-442b23837df7 tempest-AbsoluteLimitsTests-1534325527 None] Lock "cinder-5e18c58b-cf33-40a0-b0ac-3e67475f5fbf-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:31 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.595s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:31 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:16:31 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] Deleted volume successfully.
Jun 06 01:16:31 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bc688cd1-b5f0-411e-9c33-88ac5c60a1a4 tempest-VolumesCloneTest-1318742039 None] Lock "cinder-22274883-e77e-46de-9877-35a9bada24fe-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Flow 'volume_create_manager' (d37aa16a-ce66-471e-823f-8cdc6bb82ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc92f5a-7c8a-4609-9799-caebeb5a1a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc92f5a-7c8a-4609-9799-caebeb5a1a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1911969540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53964d33-6fcc-48e2-b63f-17f715750d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc1b0c7de4b40bcb46b77165faa8734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:16:34Z,use_quota=True,user_id='6aa86d07835445aca9f82f207994ec55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0be81be-0675-4665-b269-0f7b3525ef40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0be81be-0675-4665-b269-0f7b3525ef40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039124dd-6b5e-4ef8-a8a6-3852ec31ef11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039124dd-6b5e-4ef8-a8a6-3852ec31ef11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53964d33-6fcc-48e2-b63f-17f715750d9b', 'volume_name': 'volume-53964d33-6fcc-48e2-b63f-17f715750d9b', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d253cb6-cb22-4d96-aa70-5d5016736656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d253cb6-cb22-4d96-aa70-5d5016736656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf652052-88b4-47f5-a3e5-dda14e5bd0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:34 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Volume 53964d33-6fcc-48e2-b63f-17f715750d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53964d33-6fcc-48e2-b63f-17f715750d9b', 'volume_size': 1}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1911969540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53964d33-6fcc-48e2-b63f-17f715750d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc1b0c7de4b40bcb46b77165faa8734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:16:34Z,use_quota=True,user_id='6aa86d07835445aca9f82f207994ec55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Creating volume 53964d33-6fcc-48e2-b63f-17f715750d9b {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:16:34 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:34 devstack sudo[100268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b 1073741824
Jun 06 01:16:34 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Flow 'volume_create_manager' (c64e318d-5cc0-4d62-bc9a-f6d0f8a85475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9e8c02-6d40-468e-be96-3c0b47f412e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9e8c02-6d40-468e-be96-3c0b47f412e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-341973181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f810e45883415b8d8e283bddfe20c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:16:35Z,use_quota=True,user_id='1b0ef3e5be934c968fcb123886acb321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9b7e36-73b4-46cf-9cb2-f4b2fc561c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9b7e36-73b4-46cf-9cb2-f4b2fc561c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a4136f-f396-4e81-813e-3648ce548eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a4136f-f396-4e81-813e-3648ce548eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35', 'volume_name': 'volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (474b798c-4846-4535-876f-42d8a124478e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (474b798c-4846-4535-876f-42d8a124478e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c47799-eddb-4c07-87c0-dbc6e5987ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:34 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Volume dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35', 'volume_size': 1}
Jun 06 01:16:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:35 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b 1073741824" returned: 0 in 0.784s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:35 devstack sudo[100273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b
Jun 06 01:16:35 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:35 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b" returned: 0 in 0.595s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.075s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-341973181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f810e45883415b8d8e283bddfe20c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:16:35Z,use_quota=True,user_id='1b0ef3e5be934c968fcb123886acb321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Creating volume dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:16:35 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:35 devstack sudo[100276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35 1073741824
Jun 06 01:16:35 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf652052-88b4-47f5-a3e5-dda14e5bd0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53964d33-6fcc-48e2-b63f-17f715750d9b', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861e7cb7-f51a-4159-b534-27e134f698a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:35 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Volume volume-53964d33-6fcc-48e2-b63f-17f715750d9b (53964d33-6fcc-48e2-b63f-17f715750d9b): created successfully
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861e7cb7-f51a-4159-b534-27e134f698a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Flow 'volume_create_manager' (d37aa16a-ce66-471e-823f-8cdc6bb82ca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:16:35 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f2e951c8-7d0c-44bc-99a7-8cd506989972 tempest-VolumesSnapshotListTestJSON-991382677 None] Created volume successfully.
Jun 06 01:16:36 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35 1073741824" returned: 0 in 0.781s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:36 devstack sudo[100281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35
Jun 06 01:16:36 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:37 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35" returned: 0 in 0.598s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:16:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.608s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c47799-eddb-4c07-87c0-dbc6e5987ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff625369-a320-465e-8152-dc5537abfe96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:16:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] Creating offline snapshot c841ac8b-1861-49b8-92d2-b2178a7e5659 of volume 53964d33-6fcc-48e2-b63f-17f715750d9b {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:16:37 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Volume volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35 (dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35): created successfully
Jun 06 01:16:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff625369-a320-465e-8152-dc5537abfe96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:16:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Flow 'volume_create_manager' (c64e318d-5cc0-4d62-bc9a-f6d0f8a85475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:16:37 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[144da35d-1db0-497b-a3c1-3cc53d79e957]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:37 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b15a80ac-7704-4ba1-a794-c7a29e15c759 tempest-VolumesDeleteCascade-405921332 None] Created volume successfully.
Jun 06 01:16:37 devstack sudo[100284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b
Jun 06 01:16:37 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:38 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b" returned: 0 in 0.719s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:38 devstack sudo[100289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659 1G
Jun 06 01:16:38 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:38 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659 1G" returned: 0 in 0.729s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53964d33-6fcc-48e2-b63f-17f715750d9b -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:38 devstack sudo[100295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53964d33-6fcc-48e2-b63f-17f715750d9b -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659
Jun 06 01:16:38 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:39 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53964d33-6fcc-48e2-b63f-17f715750d9b -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659" returned: 0 in 0.619s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:39 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659 is being set with open permissions: ugo+rw
Jun 06 01:16:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:39 devstack sudo[100300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659
Jun 06 01:16:39 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:40 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659" returned: 0 in 0.586s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:40 devstack sudo[100303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.info
Jun 06 01:16:40 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:40 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.info" returned: 0 in 0.589s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:40 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.info is being set with open permissions: ugo+rw
Jun 06 01:16:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:40 devstack sudo[100306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.info
Jun 06 01:16:40 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:41 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.info" returned: 0 in 0.578s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.921s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.159s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] Creating offline snapshot f12095d6-914f-4b00-a7df-85499f8dae1b of volume dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:16:41 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-99720865-1f29-4a90-89cf-ba4498955ed3 tempest-VolumesSnapshotListTestJSON-991382677 None] Create snapshot completed successfully
Jun 06 01:16:41 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6304b91-4cde-483a-8bbf-7c5dbbe12da5]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:41 devstack sudo[100309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35
Jun 06 01:16:41 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:41 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35" returned: 0 in 0.693s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:42 devstack sudo[100314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b 1G
Jun 06 01:16:42 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-4f2feb65-64b4-47c7-a7f3-246a22c8872e tempest-VolumesSnapshotListTestJSON-991382677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:42 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b 1G" returned: 0 in 0.715s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:42 devstack sudo[100320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b
Jun 06 01:16:42 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:43 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b" returned: 0 in 0.647s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:43 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b is being set with open permissions: ugo+rw
Jun 06 01:16:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:43 devstack sudo[100326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b
Jun 06 01:16:43 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:43 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b" returned: 0 in 0.593s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:43 devstack sudo[100329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.info
Jun 06 01:16:43 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:44 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.info" returned: 0 in 0.578s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:44 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.info is being set with open permissions: ugo+rw
Jun 06 01:16:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:44 devstack sudo[100332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.info
Jun 06 01:16:44 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:45 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.info" returned: 0 in 0.587s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.895s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-4f2feb65-64b4-47c7-a7f3-246a22c8872e tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.083s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-4f2feb65-64b4-47c7-a7f3-246a22c8872e tempest-VolumesSnapshotListTestJSON-991382677 None] Creating offline snapshot 90c0fced-1d7a-48a1-a9f6-eb1294d83602 of volume 53964d33-6fcc-48e2-b63f-17f715750d9b {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:16:45 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b4206ccc-e466-415c-a379-804ff358641d tempest-VolumesDeleteCascade-405921332 None] Create snapshot completed successfully
Jun 06 01:16:45 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[276f09c5-800e-412e-bbe4-3c9894e88c5d]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4f2feb65-64b4-47c7-a7f3-246a22c8872e tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:45 devstack sudo[100335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659
Jun 06 01:16:45 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e6380cb3-e758-4a3a-bdbd-637bb3ba2b9b tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:45 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4f2feb65-64b4-47c7-a7f3-246a22c8872e tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659" returned: 0 in 0.726s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-4f2feb65-64b4-47c7-a7f3-246a22c8872e tempest-VolumesSnapshotListTestJSON-991382677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53964d33-6fcc-48e2-b63f-17f715750d9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:16:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4f2feb65-64b4-47c7-a7f3-246a22c8872e tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:45 devstack sudo[100340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602 1G
Jun 06 01:16:45 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:46 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4f2feb65-64b4-47c7-a7f3-246a22c8872e tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602 1G" returned: 0 in 0.778s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4f2feb65-64b4-47c7-a7f3-246a22c8872e tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:46 devstack sudo[100347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602
Jun 06 01:16:46 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:47 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4f2feb65-64b4-47c7-a7f3-246a22c8872e tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602" returned: 0 in 0.628s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:47 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-4f2feb65-64b4-47c7-a7f3-246a22c8872e tempest-VolumesSnapshotListTestJSON-991382677 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602 is being set with open permissions: ugo+rw
Jun 06 01:16:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4f2feb65-64b4-47c7-a7f3-246a22c8872e tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:47 devstack sudo[100352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602
Jun 06 01:16:47 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:47 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4f2feb65-64b4-47c7-a7f3-246a22c8872e tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602" returned: 0 in 0.593s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-4f2feb65-64b4-47c7-a7f3-246a22c8872e tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.821s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e6380cb3-e758-4a3a-bdbd-637bb3ba2b9b tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.479s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-e6380cb3-e758-4a3a-bdbd-637bb3ba2b9b tempest-VolumesDeleteCascade-405921332 None] Creating offline snapshot cab2a6b2-0745-48b1-989b-3f30eea734b3 of volume dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:16:48 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-4f2feb65-64b4-47c7-a7f3-246a22c8872e tempest-VolumesSnapshotListTestJSON-991382677 None] Create snapshot completed successfully
Jun 06 01:16:48 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[37707562-c813-4a51-9b4b-d69c56167917]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6380cb3-e758-4a3a-bdbd-637bb3ba2b9b tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:48 devstack sudo[100355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b
Jun 06 01:16:48 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ca5e525a-a090-44df-89cd-f3031cae7573 tempest-VolumesSnapshotListTestJSON-991382677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:48 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6380cb3-e758-4a3a-bdbd-637bb3ba2b9b tempest-VolumesDeleteCascade-405921332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b" returned: 0 in 0.705s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-e6380cb3-e758-4a3a-bdbd-637bb3ba2b9b tempest-VolumesDeleteCascade-405921332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:16:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6380cb3-e758-4a3a-bdbd-637bb3ba2b9b tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:48 devstack sudo[100360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3 1G
Jun 06 01:16:48 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:49 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6380cb3-e758-4a3a-bdbd-637bb3ba2b9b tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3 1G" returned: 0 in 0.760s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6380cb3-e758-4a3a-bdbd-637bb3ba2b9b tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:49 devstack sudo[100365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3
Jun 06 01:16:49 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:50 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6380cb3-e758-4a3a-bdbd-637bb3ba2b9b tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3" returned: 0 in 0.626s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:50 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-e6380cb3-e758-4a3a-bdbd-637bb3ba2b9b tempest-VolumesDeleteCascade-405921332 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3 is being set with open permissions: ugo+rw
Jun 06 01:16:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6380cb3-e758-4a3a-bdbd-637bb3ba2b9b tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:50 devstack sudo[100370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3
Jun 06 01:16:50 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:50 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e6380cb3-e758-4a3a-bdbd-637bb3ba2b9b tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3" returned: 0 in 0.582s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e6380cb3-e758-4a3a-bdbd-637bb3ba2b9b tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.763s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ca5e525a-a090-44df-89cd-f3031cae7573 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.290s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-ca5e525a-a090-44df-89cd-f3031cae7573 tempest-VolumesSnapshotListTestJSON-991382677 None] Creating offline snapshot 24d99961-88e0-4dd3-8a9b-47822b98fc6b of volume 53964d33-6fcc-48e2-b63f-17f715750d9b {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:16:50 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-e6380cb3-e758-4a3a-bdbd-637bb3ba2b9b tempest-VolumesDeleteCascade-405921332 None] Create snapshot completed successfully
Jun 06 01:16:50 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa966fa2-e85b-4597-add4-e773ed5fcecd]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ca5e525a-a090-44df-89cd-f3031cae7573 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:50 devstack sudo[100373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602
Jun 06 01:16:50 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:51 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ca5e525a-a090-44df-89cd-f3031cae7573 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602" returned: 0 in 0.677s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-ca5e525a-a090-44df-89cd-f3031cae7573 tempest-VolumesSnapshotListTestJSON-991382677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53964d33-6fcc-48e2-b63f-17f715750d9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:16:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ca5e525a-a090-44df-89cd-f3031cae7573 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:51 devstack sudo[100378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b 1G
Jun 06 01:16:51 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "cinder-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Performing cascade delete. {{(pid=86581) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 06 01:16:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "cinder-cab2a6b2-0745-48b1-989b-3f30eea734b3-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-cab2a6b2-0745-48b1-989b-3f30eea734b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "cinder-quobyte-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "cinder-quobyte-cab2a6b2-0745-48b1-989b-3f30eea734b3" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-cab2a6b2-0745-48b1-989b-3f30eea734b3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Deleting offline snapshot cab2a6b2-0745-48b1-989b-3f30eea734b3 of volume dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:16:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] snapshot_file for this snap is: volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:16:51 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[c760c2c5-84d1-416a-9f02-27c7a53b2b3a]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:52 devstack sudo[100380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3
Jun 06 01:16:52 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:52 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ca5e525a-a090-44df-89cd-f3031cae7573 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b 1G" returned: 0 in 0.787s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ca5e525a-a090-44df-89cd-f3031cae7573 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:52 devstack sudo[100385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b
Jun 06 01:16:52 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:52 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3" returned: 0 in 0.706s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:52 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:16:52 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb92cec8-b6d3-49e2-8469-470a0537a5fc]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:52 devstack sudo[100390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b
Jun 06 01:16:52 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:52 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ca5e525a-a090-44df-89cd-f3031cae7573 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b" returned: 0 in 0.633s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:52 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-ca5e525a-a090-44df-89cd-f3031cae7573 tempest-VolumesSnapshotListTestJSON-991382677 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b is being set with open permissions: ugo+rw
Jun 06 01:16:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ca5e525a-a090-44df-89cd-f3031cae7573 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:52 devstack sudo[100395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b
Jun 06 01:16:52 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:53 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b" returned: 0 in 0.718s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:16:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:53 devstack sudo[100401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3
Jun 06 01:16:53 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:53 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ca5e525a-a090-44df-89cd-f3031cae7573 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b" returned: 0 in 0.593s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ca5e525a-a090-44df-89cd-f3031cae7573 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.781s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:53 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-ca5e525a-a090-44df-89cd-f3031cae7573 tempest-VolumesSnapshotListTestJSON-991382677 None] Create snapshot completed successfully
Jun 06 01:16:54 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3" returned: 0 in 0.726s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:54 devstack sudo[100408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3
Jun 06 01:16:54 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Acquiring lock "cinder-24d99961-88e0-4dd3-8a9b-47822b98fc6b-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-24d99961-88e0-4dd3-8a9b-47822b98fc6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Acquiring lock "cinder-quobyte-53964d33-6fcc-48e2-b63f-17f715750d9b" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-quobyte-53964d33-6fcc-48e2-b63f-17f715750d9b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Acquiring lock "cinder-quobyte-24d99961-88e0-4dd3-8a9b-47822b98fc6b" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-quobyte-24d99961-88e0-4dd3-8a9b-47822b98fc6b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Deleting offline snapshot 24d99961-88e0-4dd3-8a9b-47822b98fc6b of volume 53964d33-6fcc-48e2-b63f-17f715750d9b {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] snapshot_file for this snap is: volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2b7dcf-f413-4602-a827-ecadfbad5037]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:54 devstack sudo[100410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b
Jun 06 01:16:54 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:54 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.cab2a6b2-0745-48b1-989b-3f30eea734b3" returned: 0 in 0.589s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-cab2a6b2-0745-48b1-989b-3f30eea734b3" released by "_delete_snapshot" :: held 2.840s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35" released by "delete_snapshot" :: held 2.861s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Created reservations ['6e67b8cd-e90b-4e12-bb45-41d3004595f5', '28ea194c-e785-499a-925b-830a2069db0c', 'c88bc036-060e-4d38-b837-7909d99ddb95', '5ad4d932-7a0c-414d-8dee-5c8b33f106c5'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:16:54 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Delete snapshot completed successfully.
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-cab2a6b2-0745-48b1-989b-3f30eea734b3-delete_snapshot" released by "delete_snapshot" :: held 3.005s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "cinder-f12095d6-914f-4b00-a7df-85499f8dae1b-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-f12095d6-914f-4b00-a7df-85499f8dae1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "cinder-quobyte-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "cinder-quobyte-f12095d6-914f-4b00-a7df-85499f8dae1b" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-f12095d6-914f-4b00-a7df-85499f8dae1b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Deleting offline snapshot f12095d6-914f-4b00-a7df-85499f8dae1b of volume dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] snapshot_file for this snap is: volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[810a1420-f537-452c-b1f2-bc672ecc3cdd]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:55 devstack sudo[100413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b
Jun 06 01:16:55 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:55 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b" returned: 0 in 0.718s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53964d33-6fcc-48e2-b63f-17f715750d9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:16:55 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0280c5c-27e1-4aa4-af86-bad5cbd67b35]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:55 devstack sudo[100418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602
Jun 06 01:16:55 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:55 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b" returned: 0 in 0.721s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:16:55 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5195770-92fd-4509-9319-321b32b40338]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:55 devstack sudo[100423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35
Jun 06 01:16:55 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:55 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602" returned: 0 in 0.685s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53964d33-6fcc-48e2-b63f-17f715750d9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:16:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:55 devstack sudo[100428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b
Jun 06 01:16:55 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:56 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35" returned: 0 in 0.712s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:56 devstack sudo[100435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b
Jun 06 01:16:56 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:56 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b" returned: 0 in 0.747s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:56 devstack sudo[100438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b
Jun 06 01:16:56 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:57 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b" returned: 0 in 0.681s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:57 devstack sudo[100443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b
Jun 06 01:16:57 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:57 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.24d99961-88e0-4dd3-8a9b-47822b98fc6b" returned: 0 in 0.594s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-quobyte-24d99961-88e0-4dd3-8a9b-47822b98fc6b" released by "_delete_snapshot" :: held 2.836s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-quobyte-53964d33-6fcc-48e2-b63f-17f715750d9b" released by "delete_snapshot" :: held 2.857s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Created reservations ['1b194d50-d41e-495d-81f2-fe5cab81322d', 'd4d19cdb-7ac0-4bc1-890e-d5d8e18a2ba3', '353542ab-a118-4f3a-9d54-b063ff0da51b', '22afb135-74f1-4657-8479-d06b7dcd239c'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:16:57 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Delete snapshot completed successfully.
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-4f629d11-7e74-4d1a-afc9-64a8334ff8fa tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-24d99961-88e0-4dd3-8a9b-47822b98fc6b-delete_snapshot" released by "delete_snapshot" :: held 2.982s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Acquiring lock "cinder-90c0fced-1d7a-48a1-a9f6-eb1294d83602-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-90c0fced-1d7a-48a1-a9f6-eb1294d83602-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Acquiring lock "cinder-quobyte-53964d33-6fcc-48e2-b63f-17f715750d9b" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-quobyte-53964d33-6fcc-48e2-b63f-17f715750d9b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Acquiring lock "cinder-quobyte-90c0fced-1d7a-48a1-a9f6-eb1294d83602" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-quobyte-90c0fced-1d7a-48a1-a9f6-eb1294d83602" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Deleting offline snapshot 90c0fced-1d7a-48a1-a9f6-eb1294d83602 of volume 53964d33-6fcc-48e2-b63f-17f715750d9b {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] snapshot_file for this snap is: volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adfc0cd-2a12-474f-b15d-45f6d2dc36ae]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:57 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35.f12095d6-914f-4b00-a7df-85499f8dae1b" returned: 0 in 0.650s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-f12095d6-914f-4b00-a7df-85499f8dae1b" released by "_delete_snapshot" :: held 2.859s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35" released by "delete_snapshot" :: held 2.882s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:57 devstack sudo[100447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602
Jun 06 01:16:57 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Created reservations ['a3a8f2fa-044d-4d57-9724-bcba9f62de01', '6dc4e9cf-d0e0-4432-9d4c-d329e9547d62', 'a9858198-a1f1-421c-8343-5b514570e9b0', 'ba8b67ca-6b21-4e7f-89e5-8869dd451412'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:16:57 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Delete snapshot completed successfully.
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-f12095d6-914f-4b00-a7df-85499f8dae1b-delete_snapshot" released by "delete_snapshot" :: held 3.024s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Snapshots deleted, issuing volume delete {{(pid=86581) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "cinder-quobyte-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35" acquired by "delete_volume" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68143c2-94a1-40a6-9407-42485257f7fd]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:58 devstack sudo[100449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35
Jun 06 01:16:58 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:58 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602" returned: 0 in 0.742s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53964d33-6fcc-48e2-b63f-17f715750d9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:16:58 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea76977-1e2c-4806-8b33-342e9fb326cd]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:16:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:58 devstack sudo[100454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659
Jun 06 01:16:58 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:58 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35" returned: 0 in 0.734s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:58 devstack sudo[100459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35
Jun 06 01:16:58 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:59 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659" returned: 0 in 0.721s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53964d33-6fcc-48e2-b63f-17f715750d9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:59 devstack sudo[100465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602
Jun 06 01:16:59 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:59 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35" returned: 0 in 0.624s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35" released by "delete_volume" :: held 1.412s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:59 devstack sudo[100467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:16:59 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Created reservations ['f5ab789d-d3c3-44ad-9c22-4a7bbb83ebfa', '335e4269-b62d-4a9b-8b3c-4e58fa10987d', '9fe16e34-ba01-484b-858c-e6100cbb4a98', 'fa9995f2-f164-45f7-986e-598b055f112d'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:59 devstack sudo[100469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:16:59 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:59 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602" returned: 0 in 0.761s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:16:59 devstack sudo[100476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602
Jun 06 01:16:59 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:16:59 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.635s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:16:59 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:17:00 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.632s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:17:00 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Deleted volume successfully.
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d6c88f22-6a77-43a5-ac1a-be48d1486b63 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-dbc5d5f6-ac1a-487e-8ccd-38e6d6458c35-delete_volume" released by "delete_volume" :: held 8.334s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:00 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.90c0fced-1d7a-48a1-a9f6-eb1294d83602" returned: 0 in 0.585s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-quobyte-90c0fced-1d7a-48a1-a9f6-eb1294d83602" released by "_delete_snapshot" :: held 2.909s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-quobyte-53964d33-6fcc-48e2-b63f-17f715750d9b" released by "delete_snapshot" :: held 2.940s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Created reservations ['603bebfa-cd45-4136-80bb-fed8f034611e', 'e5c90f0f-28b4-45b2-b910-6d70d81c27ce', '77b7e35a-3b69-4d55-91d6-86b1ba655484', '947eb7ad-ab3f-45a6-806c-54a730f06df8'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:17:00 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Delete snapshot completed successfully.
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3be6e8f3-7cca-439c-a4ab-4c76379e3908 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-90c0fced-1d7a-48a1-a9f6-eb1294d83602-delete_snapshot" released by "delete_snapshot" :: held 3.065s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] Acquiring lock "cinder-c841ac8b-1861-49b8-92d2-b2178a7e5659-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-c841ac8b-1861-49b8-92d2-b2178a7e5659-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] Acquiring lock "cinder-quobyte-53964d33-6fcc-48e2-b63f-17f715750d9b" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-quobyte-53964d33-6fcc-48e2-b63f-17f715750d9b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] Acquiring lock "cinder-quobyte-c841ac8b-1861-49b8-92d2-b2178a7e5659" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-quobyte-c841ac8b-1861-49b8-92d2-b2178a7e5659" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] Deleting offline snapshot c841ac8b-1861-49b8-92d2-b2178a7e5659 of volume 53964d33-6fcc-48e2-b63f-17f715750d9b {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] snapshot_file for this snap is: volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0d6fe8-0a45-4a7b-913f-cfa4f46d37fe]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Flow 'volume_create_manager' (02660af9-3fc0-4580-8a0b-7bb4e3911f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42312f09-761c-48a5-b6a1-d3f9d1a1ddf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42312f09-761c-48a5-b6a1-d3f9d1a1ddf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-617103706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f810e45883415b8d8e283bddfe20c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:17:01Z,use_quota=True,user_id='1b0ef3e5be934c968fcb123886acb321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11ecdcd-84a7-4e1d-bdb2-606744f2511f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11ecdcd-84a7-4e1d-bdb2-606744f2511f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df90635-a297-4254-816e-85a492446e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df90635-a297-4254-816e-85a492446e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec', 'volume_name': 'volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0288cf40-4723-4954-8ed1-5465f4c0515d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0288cf40-4723-4954-8ed1-5465f4c0515d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8a3883-6946-43e2-b595-dd3e5fce55c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:01 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Volume 5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec', 'volume_size': 1}
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-617103706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f810e45883415b8d8e283bddfe20c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:17:01Z,use_quota=True,user_id='1b0ef3e5be934c968fcb123886acb321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Creating volume 5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:17:01 devstack sudo[100480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659
Jun 06 01:17:01 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:17:01 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:01 devstack sudo[100482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec 1073741824
Jun 06 01:17:01 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:01 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659" returned: 0 in 0.707s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53964d33-6fcc-48e2-b63f-17f715750d9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c64531c-19a5-487c-9008-db4f69611eab]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:01 devstack sudo[100494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b
Jun 06 01:17:01 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:01 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec 1073741824" returned: 0 in 0.767s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:01 devstack sudo[100496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec
Jun 06 01:17:01 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:02 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b" returned: 0 in 0.729s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:02 devstack sudo[100502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659
Jun 06 01:17:02 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:02 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec" returned: 0 in 0.608s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:02 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:17:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8a3883-6946-43e2-b595-dd3e5fce55c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc9c496-8b0e-44b5-a79d-88f6642efad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:02 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Volume volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec (5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec): created successfully
Jun 06 01:17:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc9c496-8b0e-44b5-a79d-88f6642efad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:02 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Flow 'volume_create_manager' (02660af9-3fc0-4580-8a0b-7bb4e3911f09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:17:02 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-5bee7ce0-34e1-49c2-af84-230bc43b10c1 tempest-VolumesDeleteCascade-405921332 None] Created volume successfully.
Jun 06 01:17:03 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659" returned: 0 in 0.745s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:03 devstack sudo[100509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659
Jun 06 01:17:03 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] Creating offline snapshot 62ca7354-be43-4d37-b121-19c778026637 of volume 5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:17:03 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[86419c0c-124a-40f3-9f01-90ea98ee79f5]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:17:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:03 devstack sudo[100511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec
Jun 06 01:17:03 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:03 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b.c841ac8b-1861-49b8-92d2-b2178a7e5659" returned: 0 in 0.634s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-quobyte-c841ac8b-1861-49b8-92d2-b2178a7e5659" released by "_delete_snapshot" :: held 2.930s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-quobyte-53964d33-6fcc-48e2-b63f-17f715750d9b" released by "delete_snapshot" :: held 2.957s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:03 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] Created reservations ['a5ec3ab2-71cb-4f8d-be58-5cbec2a26b72', 'f774b53e-f63d-420b-b10c-96a4f9715dce', '8e607581-f8ca-45da-bb9e-39c06fd45e16', 'd8a1a07d-3939-427e-ad7b-5cec868bac80'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:17:03 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] Delete snapshot completed successfully.
Jun 06 01:17:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a1dff0ee-e6ec-42c4-bae2-f15c0fb5cea2 tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-c841ac8b-1861-49b8-92d2-b2178a7e5659-delete_snapshot" released by "delete_snapshot" :: held 3.140s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:03 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec" returned: 0 in 0.732s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:04 devstack sudo[100517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637 1G
Jun 06 01:17:04 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] Acquiring lock "cinder-53964d33-6fcc-48e2-b63f-17f715750d9b-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-53964d33-6fcc-48e2-b63f-17f715750d9b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] Acquiring lock "cinder-quobyte-53964d33-6fcc-48e2-b63f-17f715750d9b" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-quobyte-53964d33-6fcc-48e2-b63f-17f715750d9b" acquired by "delete_volume" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:04 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7b8a69-0261-4da1-8d77-8a8ce76a4b43]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:17:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:04 devstack sudo[100519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b
Jun 06 01:17:04 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:04 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637 1G" returned: 0 in 0.722s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:04 devstack sudo[100524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637
Jun 06 01:17:04 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:04 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b" returned: 0 in 0.735s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:04 devstack sudo[100529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b
Jun 06 01:17:04 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:05 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637" returned: 0 in 0.664s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:05 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637 is being set with open permissions: ugo+rw
Jun 06 01:17:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:05 devstack sudo[100534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637
Jun 06 01:17:05 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:05 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-53964d33-6fcc-48e2-b63f-17f715750d9b" returned: 0 in 0.624s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-quobyte-53964d33-6fcc-48e2-b63f-17f715750d9b" released by "delete_volume" :: held 1.421s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:05 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] Created reservations ['ddd02613-562d-47de-97d7-f23e3545d06e', '7ad8bf67-e26e-4513-9226-d310387eda73', '063d288e-25b1-4420-a6c3-e7bda8890598', 'c1c77614-d07d-4561-9001-2f97f462cc8d'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:17:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:17:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:17:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:05 devstack sudo[100537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:17:05 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:05 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637" returned: 0 in 0.609s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:06 devstack sudo[100540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.info
Jun 06 01:17:06 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:06 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.609s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:06 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:17:06 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] Deleted volume successfully.
Jun 06 01:17:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e329d2a4-f4a9-41a0-bd07-d0743f1ff75f tempest-VolumesSnapshotListTestJSON-991382677 None] Lock "cinder-53964d33-6fcc-48e2-b63f-17f715750d9b-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:06 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.info" returned: 0 in 0.627s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:06 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.info is being set with open permissions: ugo+rw
Jun 06 01:17:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:06 devstack sudo[100544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.info
Jun 06 01:17:06 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:07 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.info" returned: 0 in 0.591s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.028s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:07 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-59ba132f-7b6b-4c06-85d6-ea30d64f038b tempest-VolumesDeleteCascade-405921332 None] Create snapshot completed successfully
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Flow 'volume_create_manager' (e80fed47-b821-46a8-8ea8-1addbd59be8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51e1abe-bee1-4b6f-9467-77c907ecec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51e1abe-bee1-4b6f-9467-77c907ecec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1521362243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d41c58-1d2f-417a-beaa-6798b537ebf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f810e45883415b8d8e283bddfe20c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=62ca7354-be43-4d37-b121-19c778026637,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:17:08Z,use_quota=True,user_id='1b0ef3e5be934c968fcb123886acb321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6842d3b-e540-4adb-bf3b-99897e664524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6842d3b-e540-4adb-bf3b-99897e664524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63df7a9-52de-4abb-9da7-aa7aaf8523a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63df7a9-52de-4abb-9da7-aa7aaf8523a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '22d41c58-1d2f-417a-beaa-6798b537ebf6', 'volume_name': 'volume-22d41c58-1d2f-417a-beaa-6798b537ebf6', 'volume_size': 1, 'snapshot_id': '62ca7354-be43-4d37-b121-19c778026637'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce33e34-576d-42d6-a2f1-527b65ca6867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce33e34-576d-42d6-a2f1-527b65ca6867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5498a285-8b1e-423c-85b5-697c352383cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:07 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Volume 22d41c58-1d2f-417a-beaa-6798b537ebf6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-22d41c58-1d2f-417a-beaa-6798b537ebf6', 'volume_size': 1, 'snapshot_id': '62ca7354-be43-4d37-b121-19c778026637'}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "cinder-quobyte-62ca7354-be43-4d37-b121-19c778026637-22d41c58-1d2f-417a-beaa-6798b537ebf6" by "_create_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-62ca7354-be43-4d37-b121-19c778026637-22d41c58-1d2f-417a-beaa-6798b537ebf6" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Creating volume 22d41c58-1d2f-417a-beaa-6798b537ebf6 from snapshot 62ca7354-be43-4d37-b121-19c778026637 {{(pid=86581) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:17:07 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "cinder-quobyte-22d41c58-1d2f-417a-beaa-6798b537ebf6" by "_copy_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:08 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-22d41c58-1d2f-417a-beaa-6798b537ebf6" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] snapshot: 62ca7354-be43-4d37-b121-19c778026637, volume: 22d41c58-1d2f-417a-beaa-6798b537ebf6,  {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 06 01:17:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:17:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:17:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:08 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb6ad4e-37c0-4b7c-86ab-35ca7a34a005]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:17:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:08 devstack sudo[100547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637
Jun 06 01:17:08 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:08 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637" returned: 0 in 0.720s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:17:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 06 01:17:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Creating direct copy from snapshot {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 06 01:17:08 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[f574406e-acd9-40b7-a851-ffecdaa28f1a]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:17:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:08 devstack sudo[100552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec
Jun 06 01:17:08 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:09 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec" returned: 0 in 0.736s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:09 devstack cinder-volume[86581]: DEBUG cinder.utils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Path /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22d41c58-1d2f-417a-beaa-6798b537ebf6 not found in is_blk_device check {{(pid=86581) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jun 06 01:17:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22d41c58-1d2f-417a-beaa-6798b537ebf6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:09 devstack sudo[100557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22d41c58-1d2f-417a-beaa-6798b537ebf6
Jun 06 01:17:09 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22d41c58-1d2f-417a-beaa-6798b537ebf6" returned: 0 in 5.153s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:14 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f826f9-a633-4df2-8319-c646c37f93ae]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:17:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:14 devstack sudo[100607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec
Jun 06 01:17:14 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:15 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec" returned: 0 in 0.944s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:15 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Image conversion details: src /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22d41c58-1d2f-417a-beaa-6798b537ebf6 {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:17:15 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Converted 1024.00 MB image at 198.68 MB/s
Jun 06 01:17:15 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22d41c58-1d2f-417a-beaa-6798b537ebf6 is being set with open permissions: ugo+rw
Jun 06 01:17:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22d41c58-1d2f-417a-beaa-6798b537ebf6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:15 devstack sudo[100612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22d41c58-1d2f-417a-beaa-6798b537ebf6
Jun 06 01:17:15 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:16 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22d41c58-1d2f-417a-beaa-6798b537ebf6" returned: 0 in 0.616s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-22d41c58-1d2f-417a-beaa-6798b537ebf6" released by "_copy_volume_from_snapshot" :: held 8.272s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-62ca7354-be43-4d37-b121-19c778026637-22d41c58-1d2f-417a-beaa-6798b537ebf6" released by "_create_volume_from_snapshot" :: held 8.303s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.318s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:16 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5498a285-8b1e-423c-85b5-697c352383cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d41c58-1d2f-417a-beaa-6798b537ebf6', 'volume_size': 1, 'snapshot_id': '62ca7354-be43-4d37-b121-19c778026637'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:16 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd342fa-ac1d-4be1-afa4-3e9f38c3dc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:16 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Volume volume-22d41c58-1d2f-417a-beaa-6798b537ebf6 (22d41c58-1d2f-417a-beaa-6798b537ebf6): created successfully
Jun 06 01:17:16 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd342fa-ac1d-4be1-afa4-3e9f38c3dc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:16 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Flow 'volume_create_manager' (e80fed47-b821-46a8-8ea8-1addbd59be8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:17:16 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-64880e34-e9fe-4f91-a7a3-26fb28fc12e3 tempest-VolumesDeleteCascade-405921332 None] Created volume successfully.
Jun 06 01:17:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "cinder-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:16 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Performing cascade delete. {{(pid=86581) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 06 01:17:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "cinder-62ca7354-be43-4d37-b121-19c778026637-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-62ca7354-be43-4d37-b121-19c778026637-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "cinder-quobyte-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "cinder-quobyte-62ca7354-be43-4d37-b121-19c778026637" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-62ca7354-be43-4d37-b121-19c778026637" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Deleting offline snapshot 62ca7354-be43-4d37-b121-19c778026637 of volume 5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:17:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] snapshot_file for this snap is: volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:17:17 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e3747b-644a-43a7-a79d-f9a1ecb0f10d]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:17:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:17 devstack sudo[100621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637
Jun 06 01:17:17 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:17 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637" returned: 0 in 0.774s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:17:17 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a53c7c-d19b-438a-a89f-e29f9121e22f]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:17:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:18 devstack sudo[100626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec
Jun 06 01:17:18 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:18 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec" returned: 0 in 0.789s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:18 devstack sudo[100632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637
Jun 06 01:17:18 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:19 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637" returned: 0 in 0.703s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:19 devstack sudo[100637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637
Jun 06 01:17:19 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:20 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec.62ca7354-be43-4d37-b121-19c778026637" returned: 0 in 0.658s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-62ca7354-be43-4d37-b121-19c778026637" released by "_delete_snapshot" :: held 3.027s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec" released by "delete_snapshot" :: held 3.052s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:20 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Created reservations ['7d0f767f-eddb-43fb-8c9e-92d3fa12949b', 'f6a0c3d8-0240-4981-b404-8d676cea4698', 'df85ebe4-e8d1-4d83-af1d-c266f6a7668e', '6f5dafbf-adfe-4ae5-8e19-1d5b1f5f585e'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:17:20 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Delete snapshot completed successfully.
Jun 06 01:17:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-62ca7354-be43-4d37-b121-19c778026637-delete_snapshot" released by "delete_snapshot" :: held 3.219s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:20 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Snapshots deleted, issuing volume delete {{(pid=86581) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 06 01:17:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "cinder-quobyte-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec" acquired by "delete_volume" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:20 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[629fe135-2d4f-409c-8efd-88649fa51799]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:17:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:20 devstack sudo[100640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec
Jun 06 01:17:20 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:20 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec" returned: 0 in 0.706s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:21 devstack sudo[100645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec
Jun 06 01:17:21 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:21 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec" returned: 0 in 0.607s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec" released by "delete_volume" :: held 1.380s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:21 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Created reservations ['d9025d32-e4d0-40c5-8357-ee71e351c159', 'bb51b770-c22d-47c4-8a81-08a8565fe22a', '9d083c51-0e74-4f3c-a0e3-5cb415791d77', 'ec323632-a065-40a8-a6a7-b48714940e0a'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:17:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:21 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:17:21 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:17:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:21 devstack sudo[100648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:17:21 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:22 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.607s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:22 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:17:22 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Deleted volume successfully.
Jun 06 01:17:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-731cbf8a-699a-4ad4-a91c-206c2ef89691 tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-5dafd003-4a8e-4d6a-97b5-a25ed3dc8cec-delete_volume" released by "delete_volume" :: held 5.443s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "cinder-22d41c58-1d2f-417a-beaa-6798b537ebf6-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-22d41c58-1d2f-417a-beaa-6798b537ebf6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "cinder-quobyte-22d41c58-1d2f-417a-beaa-6798b537ebf6" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-22d41c58-1d2f-417a-beaa-6798b537ebf6" acquired by "delete_volume" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:22 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadb9674-ce7f-4dd9-95d6-2eb8bcdedb31]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:17:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22d41c58-1d2f-417a-beaa-6798b537ebf6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:22 devstack sudo[100651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22d41c58-1d2f-417a-beaa-6798b537ebf6
Jun 06 01:17:22 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:23 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22d41c58-1d2f-417a-beaa-6798b537ebf6" returned: 0 in 0.716s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22d41c58-1d2f-417a-beaa-6798b537ebf6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:23 devstack sudo[100659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22d41c58-1d2f-417a-beaa-6798b537ebf6
Jun 06 01:17:23 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:23 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-22d41c58-1d2f-417a-beaa-6798b537ebf6" returned: 0 in 0.642s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-quobyte-22d41c58-1d2f-417a-beaa-6798b537ebf6" released by "delete_volume" :: held 1.409s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:24 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=110,cinder:SELECT=91,cinder:INSERT=26,cinder:DELETE=11 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:17:24 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] Created reservations ['1c92ac6a-a75e-4aaa-b4a1-df9b15bacbf4', '012ec320-58e8-4b32-8b81-531299d6a987', 'b130383c-7dde-4e90-9309-b9514b325864', '9e58b51b-2a9a-4202-b63d-11ca666d7792'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:17:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:17:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:17:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:24 devstack sudo[100662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:17:24 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:24 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.616s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:24 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:17:24 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] Deleted volume successfully.
Jun 06 01:17:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-414a9968-59ad-439a-b55a-310e7ab2bdbd tempest-VolumesDeleteCascade-405921332 None] Lock "cinder-22d41c58-1d2f-417a-beaa-6798b537ebf6-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Flow 'volume_create_manager' (29270605-f9bc-49c8-84b2-cc1b25580cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6f3b80-a1b0-4f34-9b99-b74c75639ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6f3b80-a1b0-4f34-9b99-b74c75639ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1767390362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172501c0-cd6e-473f-ace7-4007a892886a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee78e10adde4a8ea44ee6b581399d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:17:31Z,use_quota=True,user_id='06f523bfc7924f2ca89a5b860e5e949f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac40571-dab5-41e2-ba7a-275f5154fd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac40571-dab5-41e2-ba7a-275f5154fd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd155038-09c5-4d58-82c6-af78841168e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd155038-09c5-4d58-82c6-af78841168e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '172501c0-cd6e-473f-ace7-4007a892886a', 'volume_name': 'volume-172501c0-cd6e-473f-ace7-4007a892886a', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a23510-8209-4f7f-82a3-e8b80d3a860d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a23510-8209-4f7f-82a3-e8b80d3a860d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30b784c-a441-483b-80df-2cc0e772a9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:30 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Volume 172501c0-cd6e-473f-ace7-4007a892886a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-172501c0-cd6e-473f-ace7-4007a892886a', 'volume_size': 1}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1767390362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172501c0-cd6e-473f-ace7-4007a892886a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee78e10adde4a8ea44ee6b581399d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:17:31Z,use_quota=True,user_id='06f523bfc7924f2ca89a5b860e5e949f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Creating volume 172501c0-cd6e-473f-ace7-4007a892886a {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:17:30 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:17:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-172501c0-cd6e-473f-ace7-4007a892886a 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:30 devstack sudo[100667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-172501c0-cd6e-473f-ace7-4007a892886a 1073741824
Jun 06 01:17:30 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:31 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-172501c0-cd6e-473f-ace7-4007a892886a 1073741824" returned: 0 in 0.860s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:31 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=109,cinder:SELECT=95,cinder:INSERT=34,cinder:DELETE=8 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:17:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-172501c0-cd6e-473f-ace7-4007a892886a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:31 devstack sudo[100676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-172501c0-cd6e-473f-ace7-4007a892886a
Jun 06 01:17:31 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:32 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-172501c0-cd6e-473f-ace7-4007a892886a" returned: 0 in 0.614s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:17:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30b784c-a441-483b-80df-2cc0e772a9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-172501c0-cd6e-473f-ace7-4007a892886a', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a62419-ce01-4945-998a-ddad30ebd8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:32 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Volume volume-172501c0-cd6e-473f-ace7-4007a892886a (172501c0-cd6e-473f-ace7-4007a892886a): created successfully
Jun 06 01:17:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a62419-ce01-4945-998a-ddad30ebd8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Flow 'volume_create_manager' (29270605-f9bc-49c8-84b2-cc1b25580cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:17:32 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-5eca343a-51f8-4db7-9fd2-40e5335e1bd4 tempest-VolumesTransfersV355Test-636387065 None] Created volume successfully.
Jun 06 01:17:33 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-965c8e44-bb46-438a-ab64-6a9d64c40e18 tempest-VolumesTransfersV355Test-1788877222 None] Transfer volume completed successfully.
Jun 06 01:17:34 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] Acquiring lock "cinder-172501c0-cd6e-473f-ace7-4007a892886a-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:34 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] Lock "cinder-172501c0-cd6e-473f-ace7-4007a892886a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:34 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] Acquiring lock "cinder-quobyte-172501c0-cd6e-473f-ace7-4007a892886a" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:34 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] Lock "cinder-quobyte-172501c0-cd6e-473f-ace7-4007a892886a" acquired by "delete_volume" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:34 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[8756d5b3-d04c-4934-9dd2-2302cfcc2fef]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:17:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-172501c0-cd6e-473f-ace7-4007a892886a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:34 devstack sudo[100680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-172501c0-cd6e-473f-ace7-4007a892886a
Jun 06 01:17:34 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:35 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-172501c0-cd6e-473f-ace7-4007a892886a" returned: 0 in 0.717s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-172501c0-cd6e-473f-ace7-4007a892886a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:35 devstack sudo[100685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-172501c0-cd6e-473f-ace7-4007a892886a
Jun 06 01:17:35 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:35 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-172501c0-cd6e-473f-ace7-4007a892886a" returned: 0 in 0.595s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:35 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] Lock "cinder-quobyte-172501c0-cd6e-473f-ace7-4007a892886a" released by "delete_volume" :: held 1.353s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:35 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] Created reservations ['130f6547-46fc-48a3-a1e2-3089d349cc01', 'f0812a44-1b52-48b2-8cfd-1c1657b12aff', 'c63bc340-fe8e-4edf-ab29-22bb4d509b13', '39107207-7c3c-4b37-8f5e-85dfc30709d6'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:17:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:17:35 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:17:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:35 devstack sudo[100688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:17:35 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:36 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.647s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:36 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:17:36 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] Deleted volume successfully.
Jun 06 01:17:36 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d62d56bf-0f01-424e-913c-446a11f95583 tempest-VolumesTransfersV355Test-2065406917 None] Lock "cinder-172501c0-cd6e-473f-ace7-4007a892886a-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Flow 'volume_create_manager' (07976249-40d1-47a9-9697-0a33f2d5145f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912f260a-5e68-478b-8310-a9162eba5e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912f260a-5e68-478b-8310-a9162eba5e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-870423696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb86338-ede8-4be9-87db-02d1b661d0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee78e10adde4a8ea44ee6b581399d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:17:37Z,use_quota=True,user_id='06f523bfc7924f2ca89a5b860e5e949f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb751751-e853-42c6-9d1f-7232a936c487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb751751-e853-42c6-9d1f-7232a936c487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c49f8f2-8471-421e-8d6a-eaa0c536820b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c49f8f2-8471-421e-8d6a-eaa0c536820b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eb86338-ede8-4be9-87db-02d1b661d0bb', 'volume_name': 'volume-4eb86338-ede8-4be9-87db-02d1b661d0bb', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7009b5ff-ff30-4583-866e-8962041f2049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7009b5ff-ff30-4583-866e-8962041f2049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda028a3-e116-4ad4-a22c-4c8df188bb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:37 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Volume 4eb86338-ede8-4be9-87db-02d1b661d0bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eb86338-ede8-4be9-87db-02d1b661d0bb', 'volume_size': 1}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-870423696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb86338-ede8-4be9-87db-02d1b661d0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee78e10adde4a8ea44ee6b581399d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:17:37Z,use_quota=True,user_id='06f523bfc7924f2ca89a5b860e5e949f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Creating volume 4eb86338-ede8-4be9-87db-02d1b661d0bb {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:17:37 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4eb86338-ede8-4be9-87db-02d1b661d0bb 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:37 devstack sudo[100692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4eb86338-ede8-4be9-87db-02d1b661d0bb 1073741824
Jun 06 01:17:37 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:37 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4eb86338-ede8-4be9-87db-02d1b661d0bb 1073741824" returned: 0 in 0.832s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4eb86338-ede8-4be9-87db-02d1b661d0bb {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:38 devstack sudo[100714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4eb86338-ede8-4be9-87db-02d1b661d0bb
Jun 06 01:17:38 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:38 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4eb86338-ede8-4be9-87db-02d1b661d0bb" returned: 0 in 0.598s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:17:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda028a3-e116-4ad4-a22c-4c8df188bb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eb86338-ede8-4be9-87db-02d1b661d0bb', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b0d267-2af3-4453-9486-6fbc92a3be60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:38 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Volume volume-4eb86338-ede8-4be9-87db-02d1b661d0bb (4eb86338-ede8-4be9-87db-02d1b661d0bb): created successfully
Jun 06 01:17:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b0d267-2af3-4453-9486-6fbc92a3be60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Flow 'volume_create_manager' (07976249-40d1-47a9-9697-0a33f2d5145f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:17:38 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-dae806f6-54e2-4763-a585-150806335cc4 tempest-VolumesTransfersV355Test-636387065 None] Created volume successfully.
Jun 06 01:17:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] Acquiring lock "cinder-4eb86338-ede8-4be9-87db-02d1b661d0bb-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] Lock "cinder-4eb86338-ede8-4be9-87db-02d1b661d0bb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] Acquiring lock "cinder-quobyte-4eb86338-ede8-4be9-87db-02d1b661d0bb" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] Lock "cinder-quobyte-4eb86338-ede8-4be9-87db-02d1b661d0bb" acquired by "delete_volume" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:39 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[326feca0-defc-4699-a666-24c550aca327]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:17:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4eb86338-ede8-4be9-87db-02d1b661d0bb {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:39 devstack sudo[100717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4eb86338-ede8-4be9-87db-02d1b661d0bb
Jun 06 01:17:39 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:40 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4eb86338-ede8-4be9-87db-02d1b661d0bb" returned: 0 in 0.705s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4eb86338-ede8-4be9-87db-02d1b661d0bb {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:40 devstack sudo[100722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4eb86338-ede8-4be9-87db-02d1b661d0bb
Jun 06 01:17:40 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:40 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4eb86338-ede8-4be9-87db-02d1b661d0bb" returned: 0 in 0.609s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:40 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] Lock "cinder-quobyte-4eb86338-ede8-4be9-87db-02d1b661d0bb" released by "delete_volume" :: held 1.351s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:40 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] Created reservations ['192fe4db-acee-48db-8bfb-29b7af1e84fa', '40ca164a-c877-49bc-835e-b93547d45cdf', '7f3e20a6-27e0-4a28-95fd-09b67136128d', 'c036d318-43cc-4aae-b7e4-53ae63576a66'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:17:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:17:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:17:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:41 devstack sudo[100728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:17:41 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:41 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.594s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:41 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:17:41 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] Deleted volume successfully.
Jun 06 01:17:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-72402e76-ccc8-4f94-a7b6-a176ca26685f tempest-VolumesTransfersV355Test-2065406917 None] Lock "cinder-4eb86338-ede8-4be9-87db-02d1b661d0bb-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:48 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Flow 'volume_create_manager' (166dedaf-e40b-4558-9c0c-1b0cac5dbdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d449fb1-0038-4779-9bf5-a380f06cfa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d449fb1-0038-4779-9bf5-a380f06cfa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-235050605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0da3b10-e6e5-472f-90ff-40a0aad07c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b0971acab944a5992a13421cf0bf24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:17:49Z,use_quota=True,user_id='24cf676755b04506a39998a41d1da5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75286ad-4af7-47b4-994b-212224b01f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75286ad-4af7-47b4-994b-212224b01f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c8e4d6-5f54-41fa-9b6c-cf6a4af00b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c8e4d6-5f54-41fa-9b6c-cf6a4af00b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0da3b10-e6e5-472f-90ff-40a0aad07c04', 'volume_name': 'volume-b0da3b10-e6e5-472f-90ff-40a0aad07c04', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785b71ad-4dfd-4cb0-923d-d8d902b1fba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785b71ad-4dfd-4cb0-923d-d8d902b1fba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c421f6-44f1-4090-baf0-8ea29b213c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:49 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Volume b0da3b10-e6e5-472f-90ff-40a0aad07c04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0da3b10-e6e5-472f-90ff-40a0aad07c04', 'volume_size': 1}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-235050605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0da3b10-e6e5-472f-90ff-40a0aad07c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b0971acab944a5992a13421cf0bf24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:17:49Z,use_quota=True,user_id='24cf676755b04506a39998a41d1da5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Creating volume b0da3b10-e6e5-472f-90ff-40a0aad07c04 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:17:49 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b0da3b10-e6e5-472f-90ff-40a0aad07c04 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:49 devstack sudo[100799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b0da3b10-e6e5-472f-90ff-40a0aad07c04 1073741824
Jun 06 01:17:49 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:49 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b0da3b10-e6e5-472f-90ff-40a0aad07c04 1073741824" returned: 0 in 0.795s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b0da3b10-e6e5-472f-90ff-40a0aad07c04 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:49 devstack sudo[100811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b0da3b10-e6e5-472f-90ff-40a0aad07c04
Jun 06 01:17:49 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:50 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b0da3b10-e6e5-472f-90ff-40a0aad07c04" returned: 0 in 0.601s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:17:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c421f6-44f1-4090-baf0-8ea29b213c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0da3b10-e6e5-472f-90ff-40a0aad07c04', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0bc848-dd3e-420f-a5d9-1285c6923e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:50 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Volume volume-b0da3b10-e6e5-472f-90ff-40a0aad07c04 (b0da3b10-e6e5-472f-90ff-40a0aad07c04): created successfully
Jun 06 01:17:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0bc848-dd3e-420f-a5d9-1285c6923e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Flow 'volume_create_manager' (166dedaf-e40b-4558-9c0c-1b0cac5dbdfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:17:50 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-0664994e-62e3-4c48-a150-b994e53e3285 tempest-VolumesTransfersV357Test-1493565229 None] Created volume successfully.
Jun 06 01:17:51 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-80fd0733-2e8e-4a61-a861-2a3bf6401206 tempest-VolumesTransfersV357Test-1685302866 None] Transfer volume completed successfully.
Jun 06 01:17:52 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] Acquiring lock "cinder-b0da3b10-e6e5-472f-90ff-40a0aad07c04-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:52 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] Lock "cinder-b0da3b10-e6e5-472f-90ff-40a0aad07c04-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:52 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] Acquiring lock "cinder-quobyte-b0da3b10-e6e5-472f-90ff-40a0aad07c04" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:52 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] Lock "cinder-quobyte-b0da3b10-e6e5-472f-90ff-40a0aad07c04" acquired by "delete_volume" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:52 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cfdc19-9fe3-4379-91be-5e9685d6e9b3]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:17:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b0da3b10-e6e5-472f-90ff-40a0aad07c04 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:52 devstack sudo[100815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b0da3b10-e6e5-472f-90ff-40a0aad07c04
Jun 06 01:17:52 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:53 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b0da3b10-e6e5-472f-90ff-40a0aad07c04" returned: 0 in 0.707s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b0da3b10-e6e5-472f-90ff-40a0aad07c04 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:53 devstack sudo[100821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b0da3b10-e6e5-472f-90ff-40a0aad07c04
Jun 06 01:17:53 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:54 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b0da3b10-e6e5-472f-90ff-40a0aad07c04" returned: 0 in 0.580s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] Lock "cinder-quobyte-b0da3b10-e6e5-472f-90ff-40a0aad07c04" released by "delete_volume" :: held 1.327s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:54 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] Created reservations ['123d04fc-1c83-49f9-bcdc-894414022f3f', '7e5f8026-e7b0-49fc-8c82-64d9264fd1ee', 'e5896e2d-a965-4610-b1e6-59067d2650ae', 'be2bb901-b9bb-40b0-b098-6e761451c52c'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:17:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:17:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:17:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:54 devstack sudo[100824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:17:54 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:54 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.617s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:54 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:17:54 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] Deleted volume successfully.
Jun 06 01:17:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cde26946-30c8-4074-9b21-66c2025c8b13 tempest-VolumesTransfersV357Test-121640349 None] Lock "cinder-b0da3b10-e6e5-472f-90ff-40a0aad07c04-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Flow 'volume_create_manager' (043dcda9-549b-40ac-a9ee-f95d314bb2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26a0d83-d3a8-4a26-a28a-1330a6c87053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26a0d83-d3a8-4a26-a28a-1330a6c87053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-317147278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5e5065-c422-4230-a45d-6ff39735f1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b0971acab944a5992a13421cf0bf24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:17:55Z,use_quota=True,user_id='24cf676755b04506a39998a41d1da5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6a3ca3-7ceb-49d2-abd9-ef424eafb6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6a3ca3-7ceb-49d2-abd9-ef424eafb6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3cd819-b56a-4bc9-9d5b-95d2b9981d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3cd819-b56a-4bc9-9d5b-95d2b9981d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a5e5065-c422-4230-a45d-6ff39735f1a7', 'volume_name': 'volume-8a5e5065-c422-4230-a45d-6ff39735f1a7', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0f2987-fd82-4750-ba2d-7972c8c52d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0f2987-fd82-4750-ba2d-7972c8c52d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b3dbd9-cf53-4ccb-8304-c0a535311a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:55 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Volume 8a5e5065-c422-4230-a45d-6ff39735f1a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a5e5065-c422-4230-a45d-6ff39735f1a7', 'volume_size': 1}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-317147278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5e5065-c422-4230-a45d-6ff39735f1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b0971acab944a5992a13421cf0bf24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:17:55Z,use_quota=True,user_id='24cf676755b04506a39998a41d1da5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Creating volume 8a5e5065-c422-4230-a45d-6ff39735f1a7 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:17:55 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:17:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8a5e5065-c422-4230-a45d-6ff39735f1a7 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:55 devstack sudo[100838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8a5e5065-c422-4230-a45d-6ff39735f1a7 1073741824
Jun 06 01:17:55 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:56 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8a5e5065-c422-4230-a45d-6ff39735f1a7 1073741824" returned: 0 in 0.780s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8a5e5065-c422-4230-a45d-6ff39735f1a7 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:56 devstack sudo[100846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8a5e5065-c422-4230-a45d-6ff39735f1a7
Jun 06 01:17:56 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:56 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8a5e5065-c422-4230-a45d-6ff39735f1a7" returned: 0 in 0.585s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:17:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b3dbd9-cf53-4ccb-8304-c0a535311a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a5e5065-c422-4230-a45d-6ff39735f1a7', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c44fb3-a2eb-4f44-a631-309b650702c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:17:56 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Volume volume-8a5e5065-c422-4230-a45d-6ff39735f1a7 (8a5e5065-c422-4230-a45d-6ff39735f1a7): created successfully
Jun 06 01:17:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c44fb3-a2eb-4f44-a631-309b650702c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:17:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Flow 'volume_create_manager' (043dcda9-549b-40ac-a9ee-f95d314bb2db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:17:56 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-ec611105-9f8a-4090-baeb-969cf2253591 tempest-VolumesTransfersV357Test-1493565229 None] Created volume successfully.
Jun 06 01:17:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] Acquiring lock "cinder-8a5e5065-c422-4230-a45d-6ff39735f1a7-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] Lock "cinder-8a5e5065-c422-4230-a45d-6ff39735f1a7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] Acquiring lock "cinder-quobyte-8a5e5065-c422-4230-a45d-6ff39735f1a7" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:17:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] Lock "cinder-quobyte-8a5e5065-c422-4230-a45d-6ff39735f1a7" acquired by "delete_volume" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:17:57 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc476216-934a-4fb5-9f4b-ccad4c1fcac3]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:17:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8a5e5065-c422-4230-a45d-6ff39735f1a7 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:57 devstack sudo[100849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8a5e5065-c422-4230-a45d-6ff39735f1a7
Jun 06 01:17:57 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:58 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8a5e5065-c422-4230-a45d-6ff39735f1a7" returned: 0 in 0.677s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8a5e5065-c422-4230-a45d-6ff39735f1a7 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:58 devstack sudo[100854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8a5e5065-c422-4230-a45d-6ff39735f1a7
Jun 06 01:17:58 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:59 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8a5e5065-c422-4230-a45d-6ff39735f1a7" returned: 0 in 0.582s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] Lock "cinder-quobyte-8a5e5065-c422-4230-a45d-6ff39735f1a7" released by "delete_volume" :: held 1.298s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] Created reservations ['ec4950ab-84fd-4af8-908d-ab28864e2b2b', '04bc9919-9edc-4d04-b7e0-05f3af9bcd08', '3954e682-6829-40d9-b556-18ea4b3915ef', 'daa4ff88-6ee9-4ea0-8d2f-50c705132295'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:59 devstack sudo[100857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:17:59 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:17:59 devstack sudo[100859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:17:59 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:17:59 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.575s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:17:59 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] Deleted volume successfully.
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f347959f-2e2c-452d-81be-b60a08590b79 tempest-VolumesTransfersV357Test-121640349 None] Lock "cinder-8a5e5065-c422-4230-a45d-6ff39735f1a7-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:17:59 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.628s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:17:59 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Flow 'volume_create_manager' (543a73c9-e423-41ae-bc89-bfa8d01cc0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9156294-88f7-4feb-9a5d-6c6629d578fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9156294-88f7-4feb-9a5d-6c6629d578fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-559520729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4792f841-e2b9-4afd-a18c-86274f98e829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c28f62f4b2484285af7a047fd8dbc923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:18:07Z,use_quota=True,user_id='e70cb9b2599e46cfa8fe05053453fb42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d26a777-760e-4b3c-8c1e-6701c0c5cf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d26a777-760e-4b3c-8c1e-6701c0c5cf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5e61e8-e8a6-42b4-bff8-6c9d0fae5dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5e61e8-e8a6-42b4-bff8-6c9d0fae5dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4792f841-e2b9-4afd-a18c-86274f98e829', 'volume_name': 'volume-4792f841-e2b9-4afd-a18c-86274f98e829', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0311017-2868-43d7-93ed-919f5b7f5a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0311017-2868-43d7-93ed-919f5b7f5a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b09204-56a6-4167-abfe-6311da218050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:07 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Volume 4792f841-e2b9-4afd-a18c-86274f98e829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4792f841-e2b9-4afd-a18c-86274f98e829', 'volume_size': 1}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-559520729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4792f841-e2b9-4afd-a18c-86274f98e829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c28f62f4b2484285af7a047fd8dbc923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:18:07Z,use_quota=True,user_id='e70cb9b2599e46cfa8fe05053453fb42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Creating volume 4792f841-e2b9-4afd-a18c-86274f98e829 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:18:07 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:18:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4792f841-e2b9-4afd-a18c-86274f98e829 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:07 devstack sudo[100866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4792f841-e2b9-4afd-a18c-86274f98e829 1073741824
Jun 06 01:18:07 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:08 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4792f841-e2b9-4afd-a18c-86274f98e829 1073741824" returned: 0 in 0.832s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4792f841-e2b9-4afd-a18c-86274f98e829 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:08 devstack sudo[100871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4792f841-e2b9-4afd-a18c-86274f98e829
Jun 06 01:18:08 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:09 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4792f841-e2b9-4afd-a18c-86274f98e829" returned: 0 in 0.630s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:18:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b09204-56a6-4167-abfe-6311da218050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4792f841-e2b9-4afd-a18c-86274f98e829', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73185f95-e01b-4e7e-a5cd-dd28b92566f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:09 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Volume volume-4792f841-e2b9-4afd-a18c-86274f98e829 (4792f841-e2b9-4afd-a18c-86274f98e829): created successfully
Jun 06 01:18:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73185f95-e01b-4e7e-a5cd-dd28b92566f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Flow 'volume_create_manager' (543a73c9-e423-41ae-bc89-bfa8d01cc0f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:18:09 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-3444c7a6-095f-47c6-8823-e8111aba628b tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Created volume successfully.
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Flow 'volume_create_manager' (692ff32c-25d7-45a3-aa97-2b4eec84fb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e559c1f8-2760-49ad-8e96-7816a14756d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e559c1f8-2760-49ad-8e96-7816a14756d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1414323184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a041ea7d-f62a-4729-8e07-259e9b7481ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6be63c2fcc54eb9baf70fbd3f52db70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:18:12Z,use_quota=True,user_id='97634b901a354965b312a3481a706d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbe4c98-a7a7-4006-834a-5df79ff847aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbe4c98-a7a7-4006-834a-5df79ff847aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef28490-3e27-4458-8d7a-d08b334a195c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef28490-3e27-4458-8d7a-d08b334a195c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a041ea7d-f62a-4729-8e07-259e9b7481ed', 'volume_name': 'volume-a041ea7d-f62a-4729-8e07-259e9b7481ed', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9449d51c-07f7-48cf-815d-3d9f63e58123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9449d51c-07f7-48cf-815d-3d9f63e58123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c7dae6-2dfe-4b1d-945b-1b0971876802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:12 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Volume a041ea7d-f62a-4729-8e07-259e9b7481ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a041ea7d-f62a-4729-8e07-259e9b7481ed', 'volume_size': 1}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1414323184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a041ea7d-f62a-4729-8e07-259e9b7481ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6be63c2fcc54eb9baf70fbd3f52db70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:18:12Z,use_quota=True,user_id='97634b901a354965b312a3481a706d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Creating volume a041ea7d-f62a-4729-8e07-259e9b7481ed {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:18:12 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:18:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:12 devstack sudo[100877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed 1073741824
Jun 06 01:18:12 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-e7bfae50-a6a4-44ef-821b-265e03eeaf79 req-51542d76-7833-4bf8-8a57-f48fa98f4fed tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:13 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed 1073741824" returned: 0 in 0.805s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:13 devstack sudo[100892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed
Jun 06 01:18:13 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:13 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed" returned: 0 in 0.609s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:18:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-e7bfae50-a6a4-44ef-821b-265e03eeaf79 req-51542d76-7833-4bf8-8a57-f48fa98f4fed tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.812s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c7dae6-2dfe-4b1d-945b-1b0971876802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a041ea7d-f62a-4729-8e07-259e9b7481ed', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22b8aca-9df8-4940-9139-587328591cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:13 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a16ad5-6f73-4158-b4c2-a62174a02540]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:18:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-e7bfae50-a6a4-44ef-821b-265e03eeaf79 req-51542d76-7833-4bf8-8a57-f48fa98f4fed tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4792f841-e2b9-4afd-a18c-86274f98e829 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:14 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Volume volume-a041ea7d-f62a-4729-8e07-259e9b7481ed (a041ea7d-f62a-4729-8e07-259e9b7481ed): created successfully
Jun 06 01:18:14 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22b8aca-9df8-4940-9139-587328591cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:14 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Flow 'volume_create_manager' (692ff32c-25d7-45a3-aa97-2b4eec84fb80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:18:14 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f4355cb7-60e7-4d74-80f7-ca5b2a6f58cf tempest-VolumesSnapshotTestJSON-419525495 None] Created volume successfully.
Jun 06 01:18:14 devstack sudo[100929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4792f841-e2b9-4afd-a18c-86274f98e829
Jun 06 01:18:14 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:14 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-e7bfae50-a6a4-44ef-821b-265e03eeaf79 req-51542d76-7833-4bf8-8a57-f48fa98f4fed tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4792f841-e2b9-4afd-a18c-86274f98e829" returned: 0 in 0.721s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-e7bfae50-a6a4-44ef-821b-265e03eeaf79 req-51542d76-7833-4bf8-8a57-f48fa98f4fed tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.754s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:14 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-e7bfae50-a6a4-44ef-821b-265e03eeaf79 req-51542d76-7833-4bf8-8a57-f48fa98f4fed tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-4792f841-e2b9-4afd-a18c-86274f98e829', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '090786c3-685b-4cbe-8de0-0501f1bc2322', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:18:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:14 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] Creating offline snapshot 044e1191-ea94-4790-90dd-1419da0b4b49 of volume a041ea7d-f62a-4729-8e07-259e9b7481ed {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:18:14 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-e7bfae50-a6a4-44ef-821b-265e03eeaf79 req-51542d76-7833-4bf8-8a57-f48fa98f4fed tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] attachment_update completed successfully.
Jun 06 01:18:14 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafb2683-ec46-4e7e-af8f-14d4bdc16db8]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:18:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:14 devstack sudo[100936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed
Jun 06 01:18:14 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:15 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed" returned: 0 in 0.713s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:15 devstack sudo[101008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49 1G
Jun 06 01:18:15 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:16 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49 1G" returned: 0 in 0.724s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a041ea7d-f62a-4729-8e07-259e9b7481ed -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:16 devstack sudo[101328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a041ea7d-f62a-4729-8e07-259e9b7481ed -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49
Jun 06 01:18:16 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:16 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a041ea7d-f62a-4729-8e07-259e9b7481ed -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49" returned: 0 in 0.611s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:16 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49 is being set with open permissions: ugo+rw
Jun 06 01:18:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:16 devstack sudo[101336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49
Jun 06 01:18:16 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:17 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49" returned: 0 in 0.582s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:17 devstack sudo[101342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.info
Jun 06 01:18:17 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:18 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.info" returned: 0 in 0.614s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:18 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.info is being set with open permissions: ugo+rw
Jun 06 01:18:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:18 devstack sudo[101345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.info
Jun 06 01:18:18 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:18 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.info" returned: 0 in 0.591s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.934s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:18 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-311296b7-6049-477c-b91c-02a599667ff3 tempest-VolumesSnapshotTestJSON-419525495 None] Create snapshot completed successfully
Jun 06 01:18:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-044e1191-ea94-4790-90dd-1419da0b4b49-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:18:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-044e1191-ea94-4790-90dd-1419da0b4b49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:18:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-quobyte-a041ea7d-f62a-4729-8e07-259e9b7481ed" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:18:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-a041ea7d-f62a-4729-8e07-259e9b7481ed" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:18:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-quobyte-044e1191-ea94-4790-90dd-1419da0b4b49" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:18:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-044e1191-ea94-4790-90dd-1419da0b4b49" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:18:19 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] Deleting offline snapshot 044e1191-ea94-4790-90dd-1419da0b4b49 of volume a041ea7d-f62a-4729-8e07-259e9b7481ed {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:18:19 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] snapshot_file for this snap is: volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:18:19 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bfa789-c02d-4911-8b96-e94987f75905]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:18:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:19 devstack sudo[101348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49
Jun 06 01:18:19 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:20 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49" returned: 0 in 0.721s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:20 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a041ea7d-f62a-4729-8e07-259e9b7481ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:18:20 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6a5b3a-4e84-4a49-bd8c-7ce324300e7a]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:18:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:20 devstack sudo[101353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed
Jun 06 01:18:20 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:20 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed" returned: 0 in 0.697s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:20 devstack sudo[101358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49
Jun 06 01:18:20 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:21 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-347ac5f1-2bc4-482e-91c1-267aff818fd9 req-5d8a5c95-3c69-400d-8ef6-e8b2ddadf21e tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Terminate volume connection completed successfully.
Jun 06 01:18:21 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-347ac5f1-2bc4-482e-91c1-267aff818fd9 req-5d8a5c95-3c69-400d-8ef6-e8b2ddadf21e tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Deleting attachment 090786c3-685b-4cbe-8de0-0501f1bc2322. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:18:21 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49" returned: 0 in 0.717s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:21 devstack sudo[101392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49
Jun 06 01:18:21 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:22 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed.044e1191-ea94-4790-90dd-1419da0b4b49" returned: 0 in 0.581s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-044e1191-ea94-4790-90dd-1419da0b4b49" released by "_delete_snapshot" :: held 2.830s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-a041ea7d-f62a-4729-8e07-259e9b7481ed" released by "delete_snapshot" :: held 2.855s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] Created reservations ['c0b0cef6-0e9a-4427-8ca9-7b5ad07ce56a', '1b977f3d-9d9c-4119-b5db-f6a073bb8a55', '61dd9bb3-479d-4c95-8a07-ee5eb3237a66', '71d4aa28-6ec6-41f3-8607-881bfe31d5d8'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:18:22 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] Delete snapshot completed successfully.
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-774fa26b-c90d-4a77-aa0f-bd0ada0653d8 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-044e1191-ea94-4790-90dd-1419da0b4b49-delete_snapshot" released by "delete_snapshot" :: held 3.003s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Flow 'volume_create_manager' (cade7257-017d-4832-a07f-ac7969505fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a892f0dc-f356-4a05-ae60-66f3bea7d312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a892f0dc-f356-4a05-ae60-66f3bea7d312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1489415506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc81582-ad7a-46fa-a322-a5484a5fc226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6be63c2fcc54eb9baf70fbd3f52db70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:18:23Z,use_quota=True,user_id='97634b901a354965b312a3481a706d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3068b07-c867-4025-bbf0-24fe19d7a364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3068b07-c867-4025-bbf0-24fe19d7a364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa3ec6d-7a47-413c-ae32-b5146a90f3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa3ec6d-7a47-413c-ae32-b5146a90f3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc81582-ad7a-46fa-a322-a5484a5fc226', 'volume_name': 'volume-2bc81582-ad7a-46fa-a322-a5484a5fc226', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314e10df-a45a-4750-afe2-c8a0d6fe22d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314e10df-a45a-4750-afe2-c8a0d6fe22d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291618b3-09e9-4ca8-a7b5-90f32cb0fd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:22 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Volume 2bc81582-ad7a-46fa-a322-a5484a5fc226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc81582-ad7a-46fa-a322-a5484a5fc226', 'volume_size': 1}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1489415506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc81582-ad7a-46fa-a322-a5484a5fc226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6be63c2fcc54eb9baf70fbd3f52db70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:18:23Z,use_quota=True,user_id='97634b901a354965b312a3481a706d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Creating volume 2bc81582-ad7a-46fa-a322-a5484a5fc226 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:18:22 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:18:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:22 devstack sudo[101395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 1073741824
Jun 06 01:18:22 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Acquiring lock "cinder-4792f841-e2b9-4afd-a18c-86274f98e829-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:18:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Lock "cinder-4792f841-e2b9-4afd-a18c-86274f98e829-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:18:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Acquiring lock "cinder-quobyte-4792f841-e2b9-4afd-a18c-86274f98e829" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:18:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Lock "cinder-quobyte-4792f841-e2b9-4afd-a18c-86274f98e829" acquired by "delete_volume" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:18:23 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f5d0f4-9855-43a3-aa70-2efd73bdf4d0]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:18:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4792f841-e2b9-4afd-a18c-86274f98e829 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:23 devstack sudo[101403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4792f841-e2b9-4afd-a18c-86274f98e829
Jun 06 01:18:23 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:23 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 1073741824" returned: 0 in 0.830s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:23 devstack sudo[101405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226
Jun 06 01:18:23 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:24 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4792f841-e2b9-4afd-a18c-86274f98e829" returned: 0 in 0.737s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4792f841-e2b9-4afd-a18c-86274f98e829 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:24 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226" returned: 0 in 0.586s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:18:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:24 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=66,cinder:SELECT=67,cinder:INSERT=18,cinder:DELETE=7 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:18:24 devstack sudo[101411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4792f841-e2b9-4afd-a18c-86274f98e829
Jun 06 01:18:24 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291618b3-09e9-4ca8-a7b5-90f32cb0fd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc81582-ad7a-46fa-a322-a5484a5fc226', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb58f80-c4e3-4d61-bd58-6d281992010c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:24 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Volume volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 (2bc81582-ad7a-46fa-a322-a5484a5fc226): created successfully
Jun 06 01:18:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb58f80-c4e3-4d61-bd58-6d281992010c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Flow 'volume_create_manager' (cade7257-017d-4832-a07f-ac7969505fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:18:24 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-144cc3ae-d63f-4a3c-a70f-8fb701bac551 tempest-VolumesSnapshotTestJSON-419525495 None] Created volume successfully.
Jun 06 01:18:24 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-4792f841-e2b9-4afd-a18c-86274f98e829" returned: 0 in 0.583s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Lock "cinder-quobyte-4792f841-e2b9-4afd-a18c-86274f98e829" released by "delete_volume" :: held 1.366s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:18:24 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Created reservations ['de2a90b5-d277-4cda-b823-3e1dd0ea5d80', '1e2919e4-8c51-4c48-9909-ee80e49cf4da', '6c6ea2e1-ed50-47bb-ad4a-4175974085fc', 'd86203f4-b4dd-4588-8849-77217c3a08b3'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:18:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:25 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:18:25 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:18:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:25 devstack sudo[101414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:18:25 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:25 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] Creating offline snapshot 2bb39c04-4325-4573-8883-dd9a2e65fe4d of volume 2bc81582-ad7a-46fa-a322-a5484a5fc226 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:18:25 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[baed0d44-a7cd-49ed-add5-49a56f71322a]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:18:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:25 devstack sudo[101416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226
Jun 06 01:18:25 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:25 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.596s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:25 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:18:25 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Deleted volume successfully.
Jun 06 01:18:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d62255c2-d612-4af2-844b-a8f6ad741725 tempest-TestServerVolumeAttachScenarioOldVersion-2127914508 None] Lock "cinder-4792f841-e2b9-4afd-a18c-86274f98e829-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:18:25 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226" returned: 0 in 0.743s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:25 devstack sudo[101423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d 1G
Jun 06 01:18:25 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:26 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d 1G" returned: 0 in 0.720s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:26 devstack sudo[101430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d
Jun 06 01:18:26 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:27 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d" returned: 0 in 0.829s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:27 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d is being set with open permissions: ugo+rw
Jun 06 01:18:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:27 devstack sudo[101474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d
Jun 06 01:18:27 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:28 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d" returned: 0 in 0.589s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:28 devstack sudo[101477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.info
Jun 06 01:18:28 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:28 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.info" returned: 0 in 0.623s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:28 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.info is being set with open permissions: ugo+rw
Jun 06 01:18:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:28 devstack sudo[101482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.info
Jun 06 01:18:28 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:29 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.info" returned: 0 in 0.647s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.240s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:29 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-2713911e-9b19-44ab-8b62-fa8f6fe59bf6 tempest-VolumesSnapshotTestJSON-419525495 None] Create snapshot completed successfully
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Flow 'volume_create_manager' (7f430280-721d-43c7-b5ab-7d7b02ca9c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b681b827-d94c-4a3b-b00f-11b6e355abb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b681b827-d94c-4a3b-b00f-11b6e355abb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1032166855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d51567-77ab-4b98-a753-bea94a75204a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6be63c2fcc54eb9baf70fbd3f52db70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:18:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2bb39c04-4325-4573-8883-dd9a2e65fe4d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:18:31Z,use_quota=True,user_id='97634b901a354965b312a3481a706d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17db7f88-81b5-412e-a992-4890299b9885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17db7f88-81b5-412e-a992-4890299b9885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411fe800-5088-4377-acfb-32bf077d22c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411fe800-5088-4377-acfb-32bf077d22c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '34d51567-77ab-4b98-a753-bea94a75204a', 'volume_name': 'volume-34d51567-77ab-4b98-a753-bea94a75204a', 'volume_size': 2, 'snapshot_id': '2bb39c04-4325-4573-8883-dd9a2e65fe4d'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb72d92-3352-4f21-a27e-2734efb6dfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb72d92-3352-4f21-a27e-2734efb6dfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a8e01a-42ff-44fe-9aa3-c56b40f67688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:30 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Volume 34d51567-77ab-4b98-a753-bea94a75204a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-34d51567-77ab-4b98-a753-bea94a75204a', 'volume_size': 2, 'snapshot_id': '2bb39c04-4325-4573-8883-dd9a2e65fe4d'}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-quobyte-2bb39c04-4325-4573-8883-dd9a2e65fe4d-34d51567-77ab-4b98-a753-bea94a75204a" by "_create_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-2bb39c04-4325-4573-8883-dd9a2e65fe4d-34d51567-77ab-4b98-a753-bea94a75204a" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Creating volume 34d51567-77ab-4b98-a753-bea94a75204a from snapshot 2bb39c04-4325-4573-8883-dd9a2e65fe4d {{(pid=86581) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-quobyte-34d51567-77ab-4b98-a753-bea94a75204a" by "_copy_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-34d51567-77ab-4b98-a753-bea94a75204a" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] snapshot: 2bb39c04-4325-4573-8883-dd9a2e65fe4d, volume: 34d51567-77ab-4b98-a753-bea94a75204a,  {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5203a6e-aaa7-4b43-bcec-cd93985a57f0]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:18:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:31 devstack sudo[101486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d
Jun 06 01:18:31 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:31 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d" returned: 0 in 0.703s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bc81582-ad7a-46fa-a322-a5484a5fc226(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:18:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 06 01:18:31 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Creating direct copy from snapshot {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 06 01:18:31 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[4802f412-f6ab-4edc-b1e9-eac9e55496cf]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:18:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:31 devstack sudo[101491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226
Jun 06 01:18:31 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:32 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226" returned: 0 in 0.703s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:32 devstack cinder-volume[86581]: DEBUG cinder.utils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Path /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34d51567-77ab-4b98-a753-bea94a75204a not found in is_blk_device check {{(pid=86581) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jun 06 01:18:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34d51567-77ab-4b98-a753-bea94a75204a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:32 devstack sudo[101497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34d51567-77ab-4b98-a753-bea94a75204a
Jun 06 01:18:32 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:37 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34d51567-77ab-4b98-a753-bea94a75204a" returned: 0 in 5.041s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:37 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1d56f0-5bd2-47f5-aed7-a4d953faa70c]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:18:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:37 devstack sudo[101512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226
Jun 06 01:18:37 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:38 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226" returned: 0 in 0.876s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:38 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Image conversion details: src /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226, size 1024.00 MB, duration 5.04 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34d51567-77ab-4b98-a753-bea94a75204a {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:18:38 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Converted 1024.00 MB image at 203.06 MB/s
Jun 06 01:18:38 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34d51567-77ab-4b98-a753-bea94a75204a is being set with open permissions: ugo+rw
Jun 06 01:18:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34d51567-77ab-4b98-a753-bea94a75204a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:38 devstack sudo[101518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34d51567-77ab-4b98-a753-bea94a75204a
Jun 06 01:18:38 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:38 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34d51567-77ab-4b98-a753-bea94a75204a" returned: 0 in 0.619s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:38 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-34d51567-77ab-4b98-a753-bea94a75204a" released by "_copy_volume_from_snapshot" :: held 8.027s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:18:38 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-2bb39c04-4325-4573-8883-dd9a2e65fe4d-34d51567-77ab-4b98-a753-bea94a75204a" released by "_create_volume_from_snapshot" :: held 8.058s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:18:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.073s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:38 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=77,cinder:DELETE=5,cinder:SELECT=59,cinder:INSERT=13 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:18:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a8e01a-42ff-44fe-9aa3-c56b40f67688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34d51567-77ab-4b98-a753-bea94a75204a', 'volume_size': 2, 'snapshot_id': '2bb39c04-4325-4573-8883-dd9a2e65fe4d'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87831e1c-96ad-439f-9af8-a00344b121f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:38 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Volume volume-34d51567-77ab-4b98-a753-bea94a75204a (34d51567-77ab-4b98-a753-bea94a75204a): created successfully
Jun 06 01:18:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87831e1c-96ad-439f-9af8-a00344b121f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Flow 'volume_create_manager' (7f430280-721d-43c7-b5ab-7d7b02ca9c7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:18:39 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-62a787fe-14f1-4a67-92f0-93891135bf6f tempest-VolumesSnapshotTestJSON-419525495 None] Created volume successfully.
Jun 06 01:18:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-34d51567-77ab-4b98-a753-bea94a75204a-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:18:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-34d51567-77ab-4b98-a753-bea94a75204a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:18:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-quobyte-34d51567-77ab-4b98-a753-bea94a75204a" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:18:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-34d51567-77ab-4b98-a753-bea94a75204a" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:18:39 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e36a50-cbcc-49d3-b1be-06222203c17a]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:18:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34d51567-77ab-4b98-a753-bea94a75204a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:39 devstack sudo[101521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34d51567-77ab-4b98-a753-bea94a75204a
Jun 06 01:18:39 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:40 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34d51567-77ab-4b98-a753-bea94a75204a" returned: 0 in 0.728s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34d51567-77ab-4b98-a753-bea94a75204a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:40 devstack sudo[101528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34d51567-77ab-4b98-a753-bea94a75204a
Jun 06 01:18:40 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:41 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-34d51567-77ab-4b98-a753-bea94a75204a" returned: 0 in 0.614s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-34d51567-77ab-4b98-a753-bea94a75204a" released by "delete_volume" :: held 1.394s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] Created reservations ['9312b027-c3c3-4e13-9d23-4e21d2f967d2', '5197072b-4d05-46c2-9606-f6bfb624741f', '1f1af824-fe5e-41e6-bed3-8cb07b739c14', '65800aeb-d4d5-4a21-8f2a-c6118158ec16'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:41 devstack sudo[101531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:18:41 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:41 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.614s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:18:41 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] Deleted volume successfully.
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f8904ff4-fbd0-450a-ae7e-3c60c6663273 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-34d51567-77ab-4b98-a753-bea94a75204a-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-2bb39c04-4325-4573-8883-dd9a2e65fe4d-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-2bb39c04-4325-4573-8883-dd9a2e65fe4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-quobyte-2bc81582-ad7a-46fa-a322-a5484a5fc226" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-2bc81582-ad7a-46fa-a322-a5484a5fc226" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-quobyte-2bb39c04-4325-4573-8883-dd9a2e65fe4d" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-2bb39c04-4325-4573-8883-dd9a2e65fe4d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] Deleting offline snapshot 2bb39c04-4325-4573-8883-dd9a2e65fe4d of volume 2bc81582-ad7a-46fa-a322-a5484a5fc226 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] snapshot_file for this snap is: volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eca65c0-63ca-4d06-87b8-c3a03ad8e797]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:18:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:42 devstack sudo[101535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d
Jun 06 01:18:42 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:42 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d" returned: 0 in 0.707s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:42 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bc81582-ad7a-46fa-a322-a5484a5fc226(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:18:42 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ace6f82-4563-4d70-adc9-8e009b6283c3]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:18:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:42 devstack sudo[101540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226
Jun 06 01:18:42 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:43 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226" returned: 0 in 0.809s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:43 devstack sudo[101547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d
Jun 06 01:18:43 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:44 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d" returned: 0 in 0.724s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:44 devstack sudo[101553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d
Jun 06 01:18:44 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:44 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226.2bb39c04-4325-4573-8883-dd9a2e65fe4d" returned: 0 in 0.620s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:44 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-2bb39c04-4325-4573-8883-dd9a2e65fe4d" released by "_delete_snapshot" :: held 2.965s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:18:44 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-2bc81582-ad7a-46fa-a322-a5484a5fc226" released by "delete_snapshot" :: held 2.989s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:18:44 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] Created reservations ['1440a717-019c-43ff-a623-30b9813dc17d', 'a90f9d46-52eb-4c6c-aa7e-9fed85c14ba7', '7bf30c1f-6875-48bf-b861-d3ae7167fc87', 'c6ccd828-5987-405c-a74e-fcea3e7432c6'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:18:45 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] Delete snapshot completed successfully.
Jun 06 01:18:45 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e4a764d9-9a0b-4211-bf86-96ad24976628 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-2bb39c04-4325-4573-8883-dd9a2e65fe4d-delete_snapshot" released by "delete_snapshot" :: held 3.156s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:18:45 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-2bc81582-ad7a-46fa-a322-a5484a5fc226-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:18:45 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-2bc81582-ad7a-46fa-a322-a5484a5fc226-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:18:45 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-quobyte-2bc81582-ad7a-46fa-a322-a5484a5fc226" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:18:45 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-2bc81582-ad7a-46fa-a322-a5484a5fc226" acquired by "delete_volume" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:18:45 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed11425-7858-4b6d-875c-87ec69ba3279]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:18:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:45 devstack sudo[101556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226
Jun 06 01:18:45 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:45 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226" returned: 0 in 0.693s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:46 devstack sudo[101561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226
Jun 06 01:18:46 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:46 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bc81582-ad7a-46fa-a322-a5484a5fc226" returned: 0 in 0.611s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-2bc81582-ad7a-46fa-a322-a5484a5fc226" released by "delete_volume" :: held 1.374s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] Created reservations ['d44b996f-8811-44b5-9541-49d32f955efe', '562fea4f-e170-4ced-a35a-22c208fe3ade', 'f74330e8-7f82-487a-885a-b1118122684d', '8fe3743b-d8af-4551-b0c7-2e49f357f69e'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:46 devstack sudo[101564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:18:46 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Flow 'volume_create_manager' (b35cbf05-e2ab-4cfd-9680-ee878bcb8efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfefdef-c5d9-4211-a343-9b05fcce2302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfefdef-c5d9-4211-a343-9b05fcce2302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-201907995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c577f8-1df7-478c-925d-ff52d9768d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18658d7d7e2c4052b4761573de599305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:18:47Z,use_quota=True,user_id='4fa930283dc244f0956972eb8c8bf4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a221ee4-8f1f-43e1-93aa-1bf3b5846266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a221ee4-8f1f-43e1-93aa-1bf3b5846266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83757fd-0a89-46d7-b79a-af41beb75785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83757fd-0a89-46d7-b79a-af41beb75785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19c577f8-1df7-478c-925d-ff52d9768d7f', 'volume_name': 'volume-19c577f8-1df7-478c-925d-ff52d9768d7f', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b2d561-760b-40c7-9862-fc2424979bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b2d561-760b-40c7-9862-fc2424979bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccfe5452-fb5f-43c4-8c74-ea4855a3c45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:46 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Volume 19c577f8-1df7-478c-925d-ff52d9768d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19c577f8-1df7-478c-925d-ff52d9768d7f', 'volume_size': 1}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-201907995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c577f8-1df7-478c-925d-ff52d9768d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18658d7d7e2c4052b4761573de599305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:18:47Z,use_quota=True,user_id='4fa930283dc244f0956972eb8c8bf4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Creating volume 19c577f8-1df7-478c-925d-ff52d9768d7f {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:18:46 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:18:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:47 devstack sudo[101566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f 1073741824
Jun 06 01:18:47 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:47 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.585s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:47 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:18:47 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] Deleted volume successfully.
Jun 06 01:18:47 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-629dc9f1-50c9-436d-a49f-a84a3b7ef13c tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-2bc81582-ad7a-46fa-a322-a5484a5fc226-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:18:47 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f 1073741824" returned: 0 in 0.815s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:47 devstack sudo[101573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f
Jun 06 01:18:47 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:47 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:18:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Flow 'volume_create_manager' (83bf1abf-2769-4581-8671-8eb7719421ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:18:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626de2d0-89e5-4842-9350-c89b61352b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626de2d0-89e5-4842-9350-c89b61352b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-897800596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6be63c2fcc54eb9baf70fbd3f52db70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:18:48Z,use_quota=True,user_id='97634b901a354965b312a3481a706d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5373cb-f8bb-476d-a671-493366b7e755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5373cb-f8bb-476d-a671-493366b7e755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524223f9-e9ea-4c22-a8cc-4b6c1d8bb701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524223f9-e9ea-4c22-a8cc-4b6c1d8bb701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf', 'volume_name': 'volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b8bb06-1967-40fe-80ce-ebbc453e225d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b8bb06-1967-40fe-80ce-ebbc453e225d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d1c4d5-1057-4e6b-a58f-856b6ea4948c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:47 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Volume 8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf', 'volume_size': 1}
Jun 06 01:18:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:48 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f" returned: 0 in 0.582s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:18:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.443s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-897800596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6be63c2fcc54eb9baf70fbd3f52db70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:18:48Z,use_quota=True,user_id='97634b901a354965b312a3481a706d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:18:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Creating volume 8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:18:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:18:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:18:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:18:48 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:18:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccfe5452-fb5f-43c4-8c74-ea4855a3c45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c577f8-1df7-478c-925d-ff52d9768d7f', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:48 devstack sudo[101576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf 1073741824
Jun 06 01:18:48 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29faf57-dc6c-4608-a731-2cd069b99f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:48 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Volume volume-19c577f8-1df7-478c-925d-ff52d9768d7f (19c577f8-1df7-478c-925d-ff52d9768d7f): created successfully
Jun 06 01:18:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29faf57-dc6c-4608-a731-2cd069b99f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Flow 'volume_create_manager' (b35cbf05-e2ab-4cfd-9680-ee878bcb8efe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:18:48 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-30500f07-4d1a-4872-9306-3d770af90ac7 tempest-VolumeDependencyTests-1261237828 None] Created volume successfully.
Jun 06 01:18:49 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf 1073741824" returned: 0 in 0.768s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:49 devstack sudo[101583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf
Jun 06 01:18:49 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:49 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf" returned: 0 in 0.601s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:18:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.629s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] Creating offline snapshot 4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb of volume 19c577f8-1df7-478c-925d-ff52d9768d7f {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:18:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d1c4d5-1057-4e6b-a58f-856b6ea4948c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683dcd39-923d-49cd-abc0-143c5c0997cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:49 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[18587ebb-2c86-4908-ab27-24504f45b07e]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:18:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:49 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Volume volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf (8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf): created successfully
Jun 06 01:18:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683dcd39-923d-49cd-abc0-143c5c0997cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:49 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Flow 'volume_create_manager' (83bf1abf-2769-4581-8671-8eb7719421ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:18:49 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-fc46c035-0033-4ca6-b962-9bb92c6bda5d tempest-VolumesSnapshotTestJSON-419525495 None] Created volume successfully.
Jun 06 01:18:49 devstack sudo[101586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f
Jun 06 01:18:49 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:50 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f" returned: 0 in 0.702s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:50 devstack sudo[101591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb 1G
Jun 06 01:18:50 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:51 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb 1G" returned: 0 in 0.787s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19c577f8-1df7-478c-925d-ff52d9768d7f -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:51 devstack sudo[101597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19c577f8-1df7-478c-925d-ff52d9768d7f -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb
Jun 06 01:18:51 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:51 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19c577f8-1df7-478c-925d-ff52d9768d7f -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb" returned: 0 in 0.632s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:51 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb is being set with open permissions: ugo+rw
Jun 06 01:18:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:52 devstack sudo[101602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb
Jun 06 01:18:52 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:52 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb" returned: 0 in 0.578s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:52 devstack sudo[101605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.info
Jun 06 01:18:52 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:53 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.info" returned: 0 in 0.586s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:53 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.info is being set with open permissions: ugo+rw
Jun 06 01:18:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:53 devstack sudo[101609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.info
Jun 06 01:18:53 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:53 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.info" returned: 0 in 0.570s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.946s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.589s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] Creating offline snapshot 96b9f105-81f1-40b6-afb3-714e52e583db of volume 8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:18:53 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-e7a17602-ec07-4807-8e1d-9208e52333f3 tempest-VolumeDependencyTests-1261237828 None] Create snapshot completed successfully
Jun 06 01:18:53 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[245229c0-f12b-4b0d-bdf5-af28d14eed4b]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:18:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:53 devstack sudo[101612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf
Jun 06 01:18:53 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:54 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf" returned: 0 in 0.702s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:54 devstack sudo[101617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db 1G
Jun 06 01:18:54 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:54 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:18:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Flow 'volume_create_manager' (72dda38d-eb03-44e4-9556-c655ae12cc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:18:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d15ac3c-bbe4-4f31-b87c-1b4093b0ee7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d15ac3c-bbe4-4f31-b87c-1b4093b0ee7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-850021337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8526a46f-5f80-4525-bed3-cc2732f44c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18658d7d7e2c4052b4761573de599305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:18:55Z,use_quota=True,user_id='4fa930283dc244f0956972eb8c8bf4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf263130-a8df-493c-9a69-4cbe8404ae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf263130-a8df-493c-9a69-4cbe8404ae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a30f457-64b9-40c3-a60f-5c7c8d543133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a30f457-64b9-40c3-a60f-5c7c8d543133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8526a46f-5f80-4525-bed3-cc2732f44c88', 'volume_name': 'volume-8526a46f-5f80-4525-bed3-cc2732f44c88', 'volume_size': 1, 'snapshot_id': '4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79541f04-b8f9-4888-a2fd-d450b80af293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79541f04-b8f9-4888-a2fd-d450b80af293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:54 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0907ebfb-7ab2-4219-90b9-f1a442d5d9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:54 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Volume 8526a46f-5f80-4525-bed3-cc2732f44c88: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8526a46f-5f80-4525-bed3-cc2732f44c88', 'volume_size': 1, 'snapshot_id': '4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb'}
Jun 06 01:18:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:55 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db 1G" returned: 0 in 0.768s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:55 devstack sudo[101623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db
Jun 06 01:18:55 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:55 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db" returned: 0 in 0.627s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:55 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db is being set with open permissions: ugo+rw
Jun 06 01:18:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:55 devstack sudo[101628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db
Jun 06 01:18:55 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:56 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db" returned: 0 in 0.592s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:56 devstack sudo[101631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.info
Jun 06 01:18:56 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:57 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.info" returned: 0 in 0.592s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:57 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.info is being set with open permissions: ugo+rw
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:57 devstack sudo[101634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.info
Jun 06 01:18:57 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:57 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.info" returned: 0 in 0.590s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.956s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.834s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Acquiring lock "cinder-quobyte-4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb-8526a46f-5f80-4525-bed3-cc2732f44c88" by "_create_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-quobyte-4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb-8526a46f-5f80-4525-bed3-cc2732f44c88" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Creating volume 8526a46f-5f80-4525-bed3-cc2732f44c88 from snapshot 4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb {{(pid=86581) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Acquiring lock "cinder-quobyte-8526a46f-5f80-4525-bed3-cc2732f44c88" by "_copy_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:18:57 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-45d2ea52-81d8-4984-aff5-82d51321a049 tempest-VolumesSnapshotTestJSON-419525495 None] Create snapshot completed successfully
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-quobyte-8526a46f-5f80-4525-bed3-cc2732f44c88" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] snapshot: 4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb, volume: 8526a46f-5f80-4525-bed3-cc2732f44c88,  {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0d6cbe-6d33-48b6-9a11-7b32a3097b89]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:18:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:57 devstack sudo[101637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb
Jun 06 01:18:57 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:58 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb" returned: 0 in 0.710s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19c577f8-1df7-478c-925d-ff52d9768d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Creating direct copy from snapshot {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfda0ad3-af27-40f3-90ff-2b164fb05347]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:58 devstack sudo[101642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f
Jun 06 01:18:58 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Flow 'volume_create_manager' (1cf4ea55-3cd6-4420-86e1-751897688e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b75bcb8-13e0-4842-9c18-2aa69130f12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b75bcb8-13e0-4842-9c18-2aa69130f12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1217183293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5439b668-c525-48d7-88ee-c566b572240c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6be63c2fcc54eb9baf70fbd3f52db70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=96b9f105-81f1-40b6-afb3-714e52e583db,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:18:59Z,use_quota=True,user_id='97634b901a354965b312a3481a706d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2f5a7c-678e-4324-9bac-8cb90bf282e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2f5a7c-678e-4324-9bac-8cb90bf282e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37715f71-bc2c-4613-8e88-b8fa8b4722b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37715f71-bc2c-4613-8e88-b8fa8b4722b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5439b668-c525-48d7-88ee-c566b572240c', 'volume_name': 'volume-5439b668-c525-48d7-88ee-c566b572240c', 'volume_size': 1, 'snapshot_id': '96b9f105-81f1-40b6-afb3-714e52e583db'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f977f27-9792-4b77-9d19-e169bd0e2b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f977f27-9792-4b77-9d19-e169bd0e2b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3114dc06-97e0-4085-ab92-76ef23b3e437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:18:58 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Volume 5439b668-c525-48d7-88ee-c566b572240c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5439b668-c525-48d7-88ee-c566b572240c', 'volume_size': 1, 'snapshot_id': '96b9f105-81f1-40b6-afb3-714e52e583db'}
Jun 06 01:18:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:59 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f" returned: 0 in 0.741s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:59 devstack cinder-volume[86581]: DEBUG cinder.utils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Path /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8526a46f-5f80-4525-bed3-cc2732f44c88 not found in is_blk_device check {{(pid=86581) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jun 06 01:18:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8526a46f-5f80-4525-bed3-cc2732f44c88 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:59 devstack sudo[101647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8526a46f-5f80-4525-bed3-cc2732f44c88
Jun 06 01:18:59 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:18:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:18:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:18:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:18:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:18:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:18:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:18:59 devstack sudo[101649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:18:59 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:18:59 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root
Jun 06 01:18:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.620s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:18:59 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:19:03 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8526a46f-5f80-4525-bed3-cc2732f44c88" returned: 0 in 4.392s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:03 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[734ba9ea-e037-43b8-9ff1-7c3cec7b268b]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:03 devstack sudo[101664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f
Jun 06 01:19:03 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:04 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f" returned: 0 in 0.820s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:04 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Image conversion details: src /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f, size 1024.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8526a46f-5f80-4525-bed3-cc2732f44c88 {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:19:04 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Converted 1024.00 MB image at 233.12 MB/s
Jun 06 01:19:04 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8526a46f-5f80-4525-bed3-cc2732f44c88 is being set with open permissions: ugo+rw
Jun 06 01:19:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8526a46f-5f80-4525-bed3-cc2732f44c88 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:04 devstack sudo[101669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8526a46f-5f80-4525-bed3-cc2732f44c88
Jun 06 01:19:04 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:05 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8526a46f-5f80-4525-bed3-cc2732f44c88" returned: 0 in 0.610s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-quobyte-8526a46f-5f80-4525-bed3-cc2732f44c88" released by "_copy_volume_from_snapshot" :: held 7.361s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-quobyte-4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb-8526a46f-5f80-4525-bed3-cc2732f44c88" released by "_create_volume_from_snapshot" :: held 7.395s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.418s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.196s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-quobyte-96b9f105-81f1-40b6-afb3-714e52e583db-5439b668-c525-48d7-88ee-c566b572240c" by "_create_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-96b9f105-81f1-40b6-afb3-714e52e583db-5439b668-c525-48d7-88ee-c566b572240c" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Creating volume 5439b668-c525-48d7-88ee-c566b572240c from snapshot 96b9f105-81f1-40b6-afb3-714e52e583db {{(pid=86581) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-quobyte-5439b668-c525-48d7-88ee-c566b572240c" by "_copy_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0907ebfb-7ab2-4219-90b9-f1a442d5d9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8526a46f-5f80-4525-bed3-cc2732f44c88', 'volume_size': 1, 'snapshot_id': '4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198de1ef-6836-40c0-a660-79c6e961a60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-5439b668-c525-48d7-88ee-c566b572240c" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] snapshot: 96b9f105-81f1-40b6-afb3-714e52e583db, volume: 5439b668-c525-48d7-88ee-c566b572240c,  {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 06 01:19:05 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Volume volume-8526a46f-5f80-4525-bed3-cc2732f44c88 (8526a46f-5f80-4525-bed3-cc2732f44c88): created successfully
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198de1ef-6836-40c0-a660-79c6e961a60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Flow 'volume_create_manager' (72dda38d-eb03-44e4-9556-c655ae12cc3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc81fd6a-aacd-4806-96ee-27eabcbe02c6]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:05 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-142313bd-72e6-4a23-a921-edc16653e8d4 tempest-VolumeDependencyTests-1261237828 None] Created volume successfully.
Jun 06 01:19:05 devstack sudo[101672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db
Jun 06 01:19:05 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] Acquiring lock "cinder-4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] Acquiring lock "cinder-quobyte-19c577f8-1df7-478c-925d-ff52d9768d7f" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-quobyte-19c577f8-1df7-478c-925d-ff52d9768d7f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] Acquiring lock "cinder-quobyte-4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-quobyte-4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] Deleting offline snapshot 4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb of volume 19c577f8-1df7-478c-925d-ff52d9768d7f {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] snapshot_file for this snap is: volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2642e44-4b52-4b2a-9605-45e558e623c9]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:05 devstack sudo[101674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb
Jun 06 01:19:05 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:06 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db" returned: 0 in 0.718s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:19:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 06 01:19:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Creating direct copy from snapshot {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 06 01:19:06 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da6cb9e-e7bd-48b6-886f-684f53b2a955]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:06 devstack sudo[101679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf
Jun 06 01:19:06 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:06 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb" returned: 0 in 0.695s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19c577f8-1df7-478c-925d-ff52d9768d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:19:06 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbe37f0-7a95-49c1-a003-365bf0034486]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:06 devstack sudo[101684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f
Jun 06 01:19:06 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:06 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf" returned: 0 in 0.728s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:06 devstack cinder-volume[86581]: DEBUG cinder.utils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Path /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5439b668-c525-48d7-88ee-c566b572240c not found in is_blk_device check {{(pid=86581) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jun 06 01:19:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5439b668-c525-48d7-88ee-c566b572240c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:06 devstack sudo[101689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5439b668-c525-48d7-88ee-c566b572240c
Jun 06 01:19:06 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:07 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f" returned: 0 in 0.722s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:07 devstack sudo[101694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb
Jun 06 01:19:07 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:08 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb" returned: 0 in 1.201s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:08 devstack sudo[101709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb
Jun 06 01:19:08 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:09 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f.4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb" returned: 0 in 1.123s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-quobyte-4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb" released by "_delete_snapshot" :: held 3.880s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-quobyte-19c577f8-1df7-478c-925d-ff52d9768d7f" released by "delete_snapshot" :: held 3.917s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:09 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] Created reservations ['1304e8c1-2081-46be-b238-6d32358dd456', '1cc3190f-4493-4962-8c56-d157d352208f', 'b44d5203-184b-4499-babe-c7738e4db56a', '2b851ec5-de99-42cc-a15b-804e3857c334'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:19:09 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] Delete snapshot completed successfully.
Jun 06 01:19:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a8b46a3b-863f-481a-a60e-450af95c57ac tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-4fba665a-c8b9-4bf4-a046-0ac1cb98c9bb-delete_snapshot" released by "delete_snapshot" :: held 4.191s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] Acquiring lock "cinder-19c577f8-1df7-478c-925d-ff52d9768d7f-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-19c577f8-1df7-478c-925d-ff52d9768d7f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] Acquiring lock "cinder-quobyte-19c577f8-1df7-478c-925d-ff52d9768d7f" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:10 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-quobyte-19c577f8-1df7-478c-925d-ff52d9768d7f" acquired by "delete_volume" :: waited 0.032s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:10 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc74a8a9-3f79-47a8-94d6-d788ac883dd6]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:10 devstack sudo[101712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f
Jun 06 01:19:10 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:11 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f" returned: 0 in 1.301s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:11 devstack sudo[101717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f
Jun 06 01:19:11 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:11 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5439b668-c525-48d7-88ee-c566b572240c" returned: 0 in 4.857s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:11 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab652187-ee73-4092-ba9b-f3eaa574dffd]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:11 devstack sudo[101719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf
Jun 06 01:19:11 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:12 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-19c577f8-1df7-478c-925d-ff52d9768d7f" returned: 0 in 0.616s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-quobyte-19c577f8-1df7-478c-925d-ff52d9768d7f" released by "delete_volume" :: held 2.031s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] Created reservations ['a54f5b94-fe17-4193-95db-9c0121fd3b9b', '204360a7-9f3c-42e0-bf0a-9965d8762c16', '82e9de5b-187a-492e-a32c-e405d78154bd', '7a4107a2-cefb-40fe-b50c-b18110170e10'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:12 devstack sudo[101722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:19:12 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] Acquiring lock "cinder-8526a46f-5f80-4525-bed3-cc2732f44c88-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-8526a46f-5f80-4525-bed3-cc2732f44c88-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] Acquiring lock "cinder-quobyte-8526a46f-5f80-4525-bed3-cc2732f44c88" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-quobyte-8526a46f-5f80-4525-bed3-cc2732f44c88" acquired by "delete_volume" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[98843195-efdb-40a7-a51c-977f33df838a]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8526a46f-5f80-4525-bed3-cc2732f44c88 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:12 devstack sudo[101726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8526a46f-5f80-4525-bed3-cc2732f44c88
Jun 06 01:19:12 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:12 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf" returned: 0 in 0.912s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Image conversion details: src /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf, size 1024.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5439b668-c525-48d7-88ee-c566b572240c {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:19:12 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Converted 1024.00 MB image at 210.74 MB/s
Jun 06 01:19:12 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5439b668-c525-48d7-88ee-c566b572240c is being set with open permissions: ugo+rw
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5439b668-c525-48d7-88ee-c566b572240c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:12 devstack sudo[101729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5439b668-c525-48d7-88ee-c566b572240c
Jun 06 01:19:12 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:12 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.612s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:19:12 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] Deleted volume successfully.
Jun 06 01:19:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cf33979a-aa88-43c5-be96-8ca2ce3ef79e tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-19c577f8-1df7-478c-925d-ff52d9768d7f-delete_volume" released by "delete_volume" :: held 2.912s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:13 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8526a46f-5f80-4525-bed3-cc2732f44c88" returned: 0 in 0.745s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8526a46f-5f80-4525-bed3-cc2732f44c88 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:13 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5439b668-c525-48d7-88ee-c566b572240c" returned: 0 in 0.579s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:13 devstack sudo[101737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8526a46f-5f80-4525-bed3-cc2732f44c88
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-5439b668-c525-48d7-88ee-c566b572240c" released by "_copy_volume_from_snapshot" :: held 7.914s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:13 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-96b9f105-81f1-40b6-afb3-714e52e583db-5439b668-c525-48d7-88ee-c566b572240c" released by "_create_volume_from_snapshot" :: held 7.960s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.982s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3114dc06-97e0-4085-ab92-76ef23b3e437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5439b668-c525-48d7-88ee-c566b572240c', 'volume_size': 1, 'snapshot_id': '96b9f105-81f1-40b6-afb3-714e52e583db'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cab27c-79cf-4b73-a951-d9317872d63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:13 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Volume volume-5439b668-c525-48d7-88ee-c566b572240c (5439b668-c525-48d7-88ee-c566b572240c): created successfully
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cab27c-79cf-4b73-a951-d9317872d63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Flow 'volume_create_manager' (1cf4ea55-3cd6-4420-86e1-751897688e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:19:13 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-ec767961-884e-47e4-92fb-42dfafdf0acf tempest-VolumesSnapshotTestJSON-419525495 None] Created volume successfully.
Jun 06 01:19:13 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8526a46f-5f80-4525-bed3-cc2732f44c88" returned: 0 in 0.584s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-quobyte-8526a46f-5f80-4525-bed3-cc2732f44c88" released by "delete_volume" :: held 1.368s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] Created reservations ['59ea52ac-183c-4c01-bf3b-5385c4987afc', '231afe56-d3fd-4a08-b97f-b58fa765acc5', 'ecc8d21e-de7a-4087-abca-3ae3b5d60633', '7eeb325e-2593-4611-9586-dcaea91ad5c2'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:13 devstack sudo[101740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:19:13 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-5439b668-c525-48d7-88ee-c566b572240c-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-5439b668-c525-48d7-88ee-c566b572240c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-quobyte-5439b668-c525-48d7-88ee-c566b572240c" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-5439b668-c525-48d7-88ee-c566b572240c" acquired by "delete_volume" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:14 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.637s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:14 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:19:14 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] Deleted volume successfully.
Jun 06 01:19:14 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c8ac96-565b-4d47-9975-9008d1a1e623]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5439b668-c525-48d7-88ee-c566b572240c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-804e73c5-7f98-4436-b72e-c5d83df59190 tempest-VolumeDependencyTests-1261237828 None] Lock "cinder-8526a46f-5f80-4525-bed3-cc2732f44c88-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:14 devstack sudo[101777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5439b668-c525-48d7-88ee-c566b572240c
Jun 06 01:19:14 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:15 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5439b668-c525-48d7-88ee-c566b572240c" returned: 0 in 0.731s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5439b668-c525-48d7-88ee-c566b572240c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:15 devstack sudo[101784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5439b668-c525-48d7-88ee-c566b572240c
Jun 06 01:19:15 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:15 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-5439b668-c525-48d7-88ee-c566b572240c" returned: 0 in 0.619s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-5439b668-c525-48d7-88ee-c566b572240c" released by "delete_volume" :: held 1.427s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:15 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] Created reservations ['7789c757-ffa5-460a-ac00-5afec63acac9', 'b363c395-bde3-4d80-b8c6-785c999658bc', 'fe36feba-6421-47b9-889c-991fe2b68936', '9d2efc95-368b-4361-9428-a0880738feeb'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:19:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:19:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:19:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:15 devstack sudo[101787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:19:15 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:16 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.580s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:16 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:19:16 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] Deleted volume successfully.
Jun 06 01:19:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15b77b3f-0b38-4ab8-bc91-14aa8a3b277f tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-5439b668-c525-48d7-88ee-c566b572240c-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-96b9f105-81f1-40b6-afb3-714e52e583db-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-96b9f105-81f1-40b6-afb3-714e52e583db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-quobyte-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-quobyte-96b9f105-81f1-40b6-afb3-714e52e583db" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-96b9f105-81f1-40b6-afb3-714e52e583db" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] Deleting offline snapshot 96b9f105-81f1-40b6-afb3-714e52e583db of volume 8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:19:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] snapshot_file for this snap is: volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:19:16 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d5cbcc-64b6-4ae7-ac12-4acfee2b3013]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:16 devstack sudo[101790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db
Jun 06 01:19:16 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:17 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db" returned: 0 in 0.725s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:19:17 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65a25e5-e3ae-4d9b-88e5-cd938a933a76]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:17 devstack sudo[101801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf
Jun 06 01:19:17 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:18 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf" returned: 0 in 0.693s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:18 devstack sudo[101806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db
Jun 06 01:19:18 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:18 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db" returned: 0 in 0.734s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:18 devstack sudo[101812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db
Jun 06 01:19:18 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Flow 'volume_create_manager' (b632b19c-55c6-4d5d-a6a8-6abe82b29721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55678f85-e15a-437e-b079-6f60a550f024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55678f85-e15a-437e-b079-6f60a550f024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeaffe506e784f60a1619290498abdf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:19:19Z,use_quota=True,user_id='27eb66e1a6a44624b3480bc1a13ad450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3a4c3a-9d7e-4fab-bcec-89280889af26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3a4c3a-9d7e-4fab-bcec-89280889af26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43b2499-a641-4bac-b775-a5bf5ddea6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.image.glance [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Creating Keystone auth plugin from conf {{(pid=86581) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 06 01:19:19 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf.96b9f105-81f1-40b6-afb3-714e52e583db" returned: 0 in 0.613s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-96b9f105-81f1-40b6-afb3-714e52e583db" released by "_delete_snapshot" :: held 2.868s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf" released by "delete_snapshot" :: held 2.888s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43b2499-a641-4bac-b775-a5bf5ddea6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe', 'volume_name': 'volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe', 'volume_size': 1, 'image_id': 'f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb0ea8b172e46425e784e88f5a152979', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eeaffe506e784f60a1619290498abdf8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea2420451b5874639fb2a8665591f7b2da81d330bb71120e735e680047bf526bf4e6c0d7599fc36736cbfe396fbe49413de0edca03ce15c184a7e838186c76a9', 'id': 'f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca', 'created_at': datetime.datetime(2026, 6, 5, 23, 19, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 23, 19, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2cc7980>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea65da91-16ce-40be-b946-e8e8a0420b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea65da91-16ce-40be-b946-e8e8a0420b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e641f3-ed21-461b-96f7-1ac726fc3e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:19 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Volume fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe', 'volume_size': 1, 'image_id': 'f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb0ea8b172e46425e784e88f5a152979', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eeaffe506e784f60a1619290498abdf8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea2420451b5874639fb2a8665591f7b2da81d330bb71120e735e680047bf526bf4e6c0d7599fc36736cbfe396fbe49413de0edca03ce15c184a7e838186c76a9', 'id': 'f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca', 'created_at': datetime.datetime(2026, 6, 5, 23, 19, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 23, 19, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2cc7980>}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Trying to clone fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe from image f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca at location (None, [{'url': 'file:///opt/stack/data/glance/images/f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca', 'metadata': {}}]). {{(pid=86581) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] Created reservations ['ed0123f0-0551-43d2-8812-011c2385a1c3', '8ee5f019-737e-41f9-940f-3f4d9feb7fd5', '9005d8fd-a492-4a83-bd80-f81a10d371f3', '40b678d7-1052-42a1-9313-7ef302d7f025'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:19:19 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] Delete snapshot completed successfully.
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-6c78434b-5ddb-4e51-a1c3-c0354eaf8dbb tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-96b9f105-81f1-40b6-afb3-714e52e583db-delete_snapshot" released by "delete_snapshot" :: held 3.057s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jun 06 01:19:19 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Image download 0.00 MB at 0.00 MB/s
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[371b1767-e157-4262-9333-4b66e759ee95]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:19 devstack sudo[101815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD
Jun 06 01:19:19 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-quobyte-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf" acquired by "delete_volume" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ddc96f-a562-4343-b21f-a65824033d39]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:20 devstack sudo[101817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf
Jun 06 01:19:20 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:20 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD" returned: 0 in 0.677s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:20 devstack sudo[101821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD
Jun 06 01:19:20 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:20 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf" returned: 0 in 0.725s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:20 devstack sudo[101826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf
Jun 06 01:19:20 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:21 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD" returned: 1 in 0.676s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:19:21 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Temporary image f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca is fetched for user 27eb66e1a6a44624b3480bc1a13ad450. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jun 06 01:19:21 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7be8a4-e73b-4bb2-81d7-d1104044054b]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:21 devstack sudo[101831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD
Jun 06 01:19:21 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:21 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf" returned: 0 in 0.611s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf" released by "delete_volume" :: held 1.392s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:21 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] Created reservations ['9ac0a2fe-b1ed-4da3-9e9b-b7ca368e9c51', 'a488295a-0711-42e3-9ab5-6645b0592f7e', 'c0c89d10-7c50-43ba-822e-07dd63d19ea7', 'bc501eb8-b65b-4a1d-814a-6bcf6c2d6351'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:19:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:21 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:19:21 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:19:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:21 devstack sudo[101834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:19:21 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:21 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD" returned: 0 in 0.665s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:21 devstack sudo[101838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD
Jun 06 01:19:21 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:22 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.606s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:19:22 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] Deleted volume successfully.
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8d58a31f-2255-4056-bc39-d4b2f6e2a55b tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-8c7e0ec3-8f1c-4feb-b546-6db7f0df75bf-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-a041ea7d-f62a-4729-8e07-259e9b7481ed-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-a041ea7d-f62a-4729-8e07-259e9b7481ed-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "cinder-quobyte-a041ea7d-f62a-4729-8e07-259e9b7481ed" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-a041ea7d-f62a-4729-8e07-259e9b7481ed" acquired by "delete_volume" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[3963fb77-371e-4a67-90a8-62922d962ab7]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:22 devstack sudo[101841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed
Jun 06 01:19:22 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:22 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD" returned: 1 in 0.725s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeaffe506e784f60a1619290498abdf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:19:19Z,use_quota=True,user_id='27eb66e1a6a44624b3480bc1a13ad450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Creating volume fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:19:22 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:22 devstack sudo[101846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe 1073741824
Jun 06 01:19:22 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:22 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed" returned: 0 in 0.686s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:22 devstack sudo[101852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed
Jun 06 01:19:22 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:23 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe 1073741824" returned: 0 in 0.795s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:23 devstack sudo[101859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe
Jun 06 01:19:23 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:23 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a041ea7d-f62a-4729-8e07-259e9b7481ed" returned: 0 in 0.612s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-quobyte-a041ea7d-f62a-4729-8e07-259e9b7481ed" released by "delete_volume" :: held 1.359s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:23 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] Created reservations ['16958e84-08f2-47c8-bf96-612b7bc73cc1', 'a5f6c853-4b3e-456d-9544-67aa8b0a631a', '8945c38c-9243-4dbc-8534-4aaaa2666f75', 'd05ffdea-fdef-4003-98a1-d687675bda1f'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:19:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:19:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:19:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:23 devstack sudo[101862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:19:23 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:24 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe" returned: 0 in 0.626s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:19:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:24 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Attempting download of f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca ((None, [{'url': 'file:///opt/stack/data/glance/images/f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca', 'metadata': {}}])) to volume fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jun 06 01:19:24 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aab009-a314-495b-b54f-95040db95bc7]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_2lbqt87m {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:24 devstack sudo[101865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_2lbqt87m
Jun 06 01:19:24 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:24 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.617s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:24 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:19:24 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] Deleted volume successfully.
Jun 06 01:19:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b8aed740-823e-4e67-930b-952cb4eb434e tempest-VolumesSnapshotTestJSON-419525495 None] Lock "cinder-a041ea7d-f62a-4729-8e07-259e9b7481ed-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:24 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_2lbqt87m" returned: 0 in 0.679s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_2lbqt87m {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:24 devstack sudo[101870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_2lbqt87m
Jun 06 01:19:24 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:25 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_2lbqt87m" returned: 1 in 0.726s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_2lbqt87m' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:19:25 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fdd432-b9cc-411d-8cae-d70e2ec0bf60]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:25 devstack sudo[101874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD
Jun 06 01:19:25 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:26 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD" returned: 0 in 0.696s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:26 devstack sudo[101881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD
Jun 06 01:19:26 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:26 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD" returned: 1 in 0.705s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:19:26 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca was raw, converting to raw {{(pid=86581) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jun 06 01:19:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:26 devstack sudo[101886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe
Jun 06 01:19:26 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:27 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe" returned: 0 in 0.750s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:27 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca_cu_g7fvodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:19:27 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Converted 0.00 MB image at 0.00 MB/s
Jun 06 01:19:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:27 devstack sudo[101892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe 1G
Jun 06 01:19:27 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:28 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe 1G" returned: 0 in 0.691s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:28 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdba7f1e-03c4-4b6b-8fde-8401ab75e016]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:28 devstack sudo[101897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe
Jun 06 01:19:28 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:29 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe" returned: 0 in 0.695s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:29 devstack sudo[101901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe
Jun 06 01:19:29 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:29 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe" returned: 1 in 0.722s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:19:29 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Downloaded image f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca ((None, [{'url': 'file:///opt/stack/data/glance/images/f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca', 'metadata': {}}])) to volume fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe successfully. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jun 06 01:19:29 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Temporary image f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca for user 27eb66e1a6a44624b3480bc1a13ad450 is deleted. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jun 06 01:19:29 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Marking volume fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe as bootable. {{(pid=86581) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jun 06 01:19:29 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=88,cinder:INSERT=25,cinder:UPDATE=107,cinder:DELETE=8 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:19:29 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Copying metadata from image f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca to fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe. {{(pid=86581) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 06 01:19:29 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Creating volume glance metadata for volume fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe backed by image f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca with: {'image_id': 'f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'eb0ea8b172e46425e784e88f5a152979', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86581) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 06 01:19:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e641f3-ed21-461b-96f7-1ac726fc3e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe', 'volume_size': 1, 'image_id': 'f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb0ea8b172e46425e784e88f5a152979', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eeaffe506e784f60a1619290498abdf8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea2420451b5874639fb2a8665591f7b2da81d330bb71120e735e680047bf526bf4e6c0d7599fc36736cbfe396fbe49413de0edca03ce15c184a7e838186c76a9', 'id': 'f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca', 'created_at': datetime.datetime(2026, 6, 5, 23, 19, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 23, 19, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bd38d4-4f6b-43e7-8b1f-a4e269c0feca/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2cc7980>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a03d5e8-34d1-44db-834c-f46e10d8e550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:29 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Volume volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe (fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe): created successfully
Jun 06 01:19:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a03d5e8-34d1-44db-834c-f46e10d8e550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Flow 'volume_create_manager' (b632b19c-55c6-4d5d-a6a8-6abe82b29721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:19:29 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-34a81e4f-d32f-49cf-8ba8-7e4324492f74 tempest-VolumeImageDependencyTests-445563565 None] Created volume successfully.
Jun 06 01:19:31 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Acquiring lock "cinder-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:31 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Lock "cinder-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:31 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Acquiring lock "cinder-quobyte-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:19:31 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Lock "cinder-quobyte-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe" acquired by "delete_volume" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:19:31 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd33be1f-75e9-4a87-85c1-76d11ca31af6]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:19:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:31 devstack sudo[101906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe
Jun 06 01:19:31 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:31 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe" returned: 0 in 0.720s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:31 devstack sudo[101910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe
Jun 06 01:19:31 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:32 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe" returned: 1 in 0.747s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:19:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:32 devstack sudo[101915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe
Jun 06 01:19:32 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:33 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe" returned: 0 in 0.592s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:33 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Lock "cinder-quobyte-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe" released by "delete_volume" :: held 2.122s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:33 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Created reservations ['5086b55c-da6c-438e-9829-05f895046264', '97688462-5a23-496a-8429-55bb5e9a6f13', '11357051-b962-413c-b163-3e2243d795c6', 'a0a6b020-d282-498e-a33b-7808c3f1831e'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:19:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:33 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:19:33 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:19:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:33 devstack sudo[101919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:19:33 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:34 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.726s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:34 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:19:34 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Deleted volume successfully.
Jun 06 01:19:34 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cb92622d-1607-40c2-820e-1d3bc2950bda tempest-VolumeImageDependencyTests-445563565 None] Lock "cinder-fdb0b3c3-51ae-4603-b82a-4a9bfafc43fe-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:19:43 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=8,cinder:INSERT=5,cinder:UPDATE=11 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:19:44 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=90,cinder:SELECT=77,cinder:INSERT=30,cinder:DELETE=10 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Flow 'volume_create_manager' (2d9de715-c1c6-4f76-b276-112bcf45811a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc056ab0-60cd-4376-b020-1312684756b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc056ab0-60cd-4376-b020-1312684756b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-449670480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45778e9-057a-48f1-a1de-3879c94ac9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='397351f7f94b4532b2a7348db038b844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:19:56Z,use_quota=True,user_id='ca70ed3763704364a457fb627634aaf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e412046a-228d-457a-843d-500a49dfd7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e412046a-228d-457a-843d-500a49dfd7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74273125-4619-455e-89d7-b41411496c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74273125-4619-455e-89d7-b41411496c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a45778e9-057a-48f1-a1de-3879c94ac9dc', 'volume_name': 'volume-a45778e9-057a-48f1-a1de-3879c94ac9dc', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5ccd07-6514-4ae7-beaf-d7100ae8655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5ccd07-6514-4ae7-beaf-d7100ae8655d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929081dd-aa5a-4817-8d77-a5050ccf4295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:55 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Volume a45778e9-057a-48f1-a1de-3879c94ac9dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a45778e9-057a-48f1-a1de-3879c94ac9dc', 'volume_size': 1}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-449670480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45778e9-057a-48f1-a1de-3879c94ac9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='397351f7f94b4532b2a7348db038b844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:19:56Z,use_quota=True,user_id='ca70ed3763704364a457fb627634aaf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Creating volume a45778e9-057a-48f1-a1de-3879c94ac9dc {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:19:55 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:19:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:55 devstack sudo[101926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc 1073741824
Jun 06 01:19:55 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:56 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc 1073741824" returned: 0 in 0.785s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:56 devstack sudo[101932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc
Jun 06 01:19:56 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:57 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc" returned: 0 in 0.662s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929081dd-aa5a-4817-8d77-a5050ccf4295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a45778e9-057a-48f1-a1de-3879c94ac9dc', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e1fa73-2ef0-4b66-9a16-9dab5b31c593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Flow 'volume_create_manager' (db1b07d4-a9d9-444f-9cf2-89af73699b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae02373-93ff-44e7-a8bc-4435f1c703ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:57 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Volume volume-a45778e9-057a-48f1-a1de-3879c94ac9dc (a45778e9-057a-48f1-a1de-3879c94ac9dc): created successfully
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e1fa73-2ef0-4b66-9a16-9dab5b31c593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Flow 'volume_create_manager' (2d9de715-c1c6-4f76-b276-112bcf45811a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae02373-93ff-44e7-a8bc-4435f1c703ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-992241412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1244ddb7-bc8d-47aa-b00a-f472ac60275e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ab18d086c74c179b719f5c7eda3e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:19:57Z,use_quota=True,user_id='1d69e104485144699714f17f98d56d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f031afb8-98e9-4be0-856c-0fd4917b19c0),volume_type_id=f031afb8-98e9-4be0-856c-0fd4917b19c0)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1094c20-0277-4a1d-9551-26834de680c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1094c20-0277-4a1d-9551-26834de680c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8284e17c-28c4-4c4d-87fe-1b9b7cdd3dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8284e17c-28c4-4c4d-87fe-1b9b7cdd3dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1244ddb7-bc8d-47aa-b00a-f472ac60275e', 'volume_name': 'volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae318fc0-f4db-429f-a808-a848c80f6fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae318fc0-f4db-429f-a808-a848c80f6fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f77bc5e-1950-429f-a863-4961604cf979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:57 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Volume 1244ddb7-bc8d-47aa-b00a-f472ac60275e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e', 'volume_size': 1}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-992241412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1244ddb7-bc8d-47aa-b00a-f472ac60275e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ab18d086c74c179b719f5c7eda3e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:19:57Z,use_quota=True,user_id='1d69e104485144699714f17f98d56d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f031afb8-98e9-4be0-856c-0fd4917b19c0),volume_type_id=f031afb8-98e9-4be0-856c-0fd4917b19c0)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Creating volume 1244ddb7-bc8d-47aa-b00a-f472ac60275e {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:19:57 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:57 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d95462fa-47f4-41fe-a69f-1d894efc341b tempest-SnapshotDependencyTests-269699442 None] Created volume successfully.
Jun 06 01:19:57 devstack sudo[101935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e 1073741824
Jun 06 01:19:57 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Flow 'volume_create_manager' (ff7db197-f639-42ef-89d6-12a735d466e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b382c2f-4109-470d-9a4d-610ab7c761ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b382c2f-4109-470d-9a4d-610ab7c761ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1293471932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945a13f4-03ef-4224-9881-145aa4193e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ab18d086c74c179b719f5c7eda3e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:19:58Z,use_quota=True,user_id='1d69e104485144699714f17f98d56d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23b62854-d8ac-463e-84cd-271ebd233ffe),volume_type_id=23b62854-d8ac-463e-84cd-271ebd233ffe)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d255a11-5941-4b59-8662-b8928133643b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d255a11-5941-4b59-8662-b8928133643b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a083d134-274e-4321-9dd7-77585117ae4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a083d134-274e-4321-9dd7-77585117ae4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '945a13f4-03ef-4224-9881-145aa4193e91', 'volume_name': 'volume-945a13f4-03ef-4224-9881-145aa4193e91', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e772ba32-2d60-4a64-9f73-704f48e5b4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e772ba32-2d60-4a64-9f73-704f48e5b4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d79bc39-531f-43f1-ae22-410058771d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:57 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Volume 945a13f4-03ef-4224-9881-145aa4193e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-945a13f4-03ef-4224-9881-145aa4193e91', 'volume_size': 1}
Jun 06 01:19:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Flow 'volume_create_manager' (a470059c-39d2-4be5-ae1c-dfa724b4e4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd263d21-02e5-4910-a699-1e8f96b30414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd263d21-02e5-4910-a699-1e8f96b30414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-479479050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77c095d-5d16-4bbb-9bf6-a376c3a6541d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ab18d086c74c179b719f5c7eda3e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:19:58Z,use_quota=True,user_id='1d69e104485144699714f17f98d56d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(414bdc9e-1f37-4b35-9c59-190696fb7f8f),volume_type_id=414bdc9e-1f37-4b35-9c59-190696fb7f8f)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c1ff1d-8c0f-4060-a8c5-fce1ff235115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c1ff1d-8c0f-4060-a8c5-fce1ff235115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbec91fd-15f5-460e-97ff-188eefc4736d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.image.glance [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Creating Keystone auth plugin from conf {{(pid=86581) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 06 01:19:58 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e 1073741824" returned: 0 in 0.920s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:58 devstack sudo[101942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e
Jun 06 01:19:58 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbec91fd-15f5-460e-97ff-188eefc4736d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd77c095d-5d16-4bbb-9bf6-a376c3a6541d', 'volume_name': 'volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d', 'volume_size': 1, 'image_id': '1cdfafc2-9626-4888-834e-0c5644eadff7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cdfafc2-9626-4888-834e-0c5644eadff7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--145688281', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd9ab18d086c74c179b719f5c7eda3e5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cdfafc2-9626-4888-834e-0c5644eadff7', 'created_at': datetime.datetime(2026, 6, 5, 23, 19, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 23, 19, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cdfafc2-9626-4888-834e-0c5644eadff7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2d1fa70>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbdb2438-c576-477b-8b1b-1f630cf20b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbdb2438-c576-477b-8b1b-1f630cf20b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8557c6a-20cf-434c-90f0-acebb0746607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:58 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Volume d77c095d-5d16-4bbb-9bf6-a376c3a6541d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d', 'volume_size': 1, 'image_id': '1cdfafc2-9626-4888-834e-0c5644eadff7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cdfafc2-9626-4888-834e-0c5644eadff7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--145688281', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd9ab18d086c74c179b719f5c7eda3e5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cdfafc2-9626-4888-834e-0c5644eadff7', 'created_at': datetime.datetime(2026, 6, 5, 23, 19, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 23, 19, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cdfafc2-9626-4888-834e-0c5644eadff7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2d1fa70>}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Trying to clone d77c095d-5d16-4bbb-9bf6-a376c3a6541d from image 1cdfafc2-9626-4888-834e-0c5644eadff7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1cdfafc2-9626-4888-834e-0c5644eadff7', 'metadata': {}}]). {{(pid=86581) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Jun 06 01:19:58 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e" returned: 0 in 0.605s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.256s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1293471932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945a13f4-03ef-4224-9881-145aa4193e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ab18d086c74c179b719f5c7eda3e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:19:58Z,use_quota=True,user_id='1d69e104485144699714f17f98d56d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23b62854-d8ac-463e-84cd-271ebd233ffe),volume_type_id=23b62854-d8ac-463e-84cd-271ebd233ffe)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Creating volume 945a13f4-03ef-4224-9881-145aa4193e91 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:19:58 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:19:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-945a13f4-03ef-4224-9881-145aa4193e91 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:59 devstack sudo[101945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-945a13f4-03ef-4224-9881-145aa4193e91 1073741824
Jun 06 01:19:59 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f77bc5e-1950-429f-a863-4961604cf979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfdcd813-c11e-4887-9593-48faf4a92c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:19:59 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Volume volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e (1244ddb7-bc8d-47aa-b00a-f472ac60275e): created successfully
Jun 06 01:19:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfdcd813-c11e-4887-9593-48faf4a92c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:19:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Flow 'volume_create_manager' (db1b07d4-a9d9-444f-9cf2-89af73699b10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:19:59 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-a91fb92a-e5ad-4bf2-92dc-aff1389a8c10 tempest-TestInstancesWithCinderVolumes-969883898 None] Created volume successfully.
Jun 06 01:19:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:19:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:19:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:19:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:19:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:19:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:19:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:59 devstack sudo[101947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:19:59 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:19:59 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root
Jun 06 01:19:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-945a13f4-03ef-4224-9881-145aa4193e91 1073741824" returned: 0 in 0.818s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:19:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-945a13f4-03ef-4224-9881-145aa4193e91 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:19:59 devstack sudo[101954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-945a13f4-03ef-4224-9881-145aa4193e91
Jun 06 01:19:59 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:00 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.673s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:20:00 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-945a13f4-03ef-4224-9881-145aa4193e91" returned: 0 in 0.645s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:20:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:20:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.285s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:20:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d79bc39-531f-43f1-ae22-410058771d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-945a13f4-03ef-4224-9881-145aa4193e91', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:20:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cacc05e4-a999-4fc5-a096-1199ace4a07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:20:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] Creating offline snapshot d90cdf53-692b-47a8-b0f4-722e7a5c2817 of volume a45778e9-057a-48f1-a1de-3879c94ac9dc {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:20:00 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Volume volume-945a13f4-03ef-4224-9881-145aa4193e91 (945a13f4-03ef-4224-9881-145aa4193e91): created successfully
Jun 06 01:20:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cacc05e4-a999-4fc5-a096-1199ace4a07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:20:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Flow 'volume_create_manager' (ff7db197-f639-42ef-89d6-12a735d466e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:20:00 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[be73a95d-60e6-4e48-970d-239cb81a5227]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:20:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:00 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-1c4511c8-767c-4c1f-968d-6ea72809f2ac tempest-TestInstancesWithCinderVolumes-969883898 None] Created volume successfully.
Jun 06 01:20:00 devstack sudo[101958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc
Jun 06 01:20:00 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:01 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc" returned: 0 in 0.738s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:01 devstack sudo[101963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817 1G
Jun 06 01:20:01 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:01 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1cdfafc2-9626-4888-834e-0c5644eadff7_jopqzowudevstack@QuobyteHD, size 20.69 MB, duration 3.20 sec {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jun 06 01:20:01 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Image download 20.69 MB at 6.47 MB/s
Jun 06 01:20:01 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd18921e-f0a0-48b9-b154-33fd05816399]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:20:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdfafc2-9626-4888-834e-0c5644eadff7_jopqzowudevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:01 devstack sudo[101965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdfafc2-9626-4888-834e-0c5644eadff7_jopqzowudevstack@QuobyteHD
Jun 06 01:20:01 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:02 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817 1G" returned: 0 in 0.735s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a45778e9-057a-48f1-a1de-3879c94ac9dc -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:02 devstack sudo[101973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a45778e9-057a-48f1-a1de-3879c94ac9dc -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817
Jun 06 01:20:02 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:02 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdfafc2-9626-4888-834e-0c5644eadff7_jopqzowudevstack@QuobyteHD" returned: 0 in 0.711s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:02 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Temporary image 1cdfafc2-9626-4888-834e-0c5644eadff7 is fetched for user 1d69e104485144699714f17f98d56d92. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jun 06 01:20:02 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaf7390-52b8-4c4a-b3e2-44c28c7f89bb]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:20:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdfafc2-9626-4888-834e-0c5644eadff7_jopqzowudevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:02 devstack sudo[101981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdfafc2-9626-4888-834e-0c5644eadff7_jopqzowudevstack@QuobyteHD
Jun 06 01:20:02 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:02 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a45778e9-057a-48f1-a1de-3879c94ac9dc -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817" returned: 0 in 0.616s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:02 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817 is being set with open permissions: ugo+rw
Jun 06 01:20:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:02 devstack sudo[101983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817
Jun 06 01:20:02 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:03 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdfafc2-9626-4888-834e-0c5644eadff7_jopqzowudevstack@QuobyteHD" returned: 0 in 0.652s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:20:03 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817" returned: 0 in 0.601s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:03 devstack sudo[101990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.info
Jun 06 01:20:03 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:03 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.info" returned: 0 in 0.596s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:03 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.info is being set with open permissions: ugo+rw
Jun 06 01:20:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:03 devstack sudo[101993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.info
Jun 06 01:20:03 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:04 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.info" returned: 0 in 0.593s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:20:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.311s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:20:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-479479050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77c095d-5d16-4bbb-9bf6-a376c3a6541d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ab18d086c74c179b719f5c7eda3e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:19:58Z,use_quota=True,user_id='1d69e104485144699714f17f98d56d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(414bdc9e-1f37-4b35-9c59-190696fb7f8f),volume_type_id=414bdc9e-1f37-4b35-9c59-190696fb7f8f)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:20:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Creating volume d77c095d-5d16-4bbb-9bf6-a376c3a6541d {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:20:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:20:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:20:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:20:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:20:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:20:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:20:04 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:20:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:04 devstack sudo[101996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d 1073741824
Jun 06 01:20:04 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:04 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-fa1140b5-d05c-428a-b0dc-7931f9225c05 tempest-SnapshotDependencyTests-269699442 None] Create snapshot completed successfully
Jun 06 01:20:05 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d 1073741824" returned: 0 in 0.764s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:05 devstack sudo[102001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d
Jun 06 01:20:05 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:05 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:20:05 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Flow 'volume_create_manager' (2ceb83ff-35fe-4eba-91fc-f880ab5a9960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:20:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5801c4cf-b119-455e-8caf-bb049afeae71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:20:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d" returned: 0 in 0.646s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:20:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:20:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5801c4cf-b119-455e-8caf-bb049afeae71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d82867-5d4a-4076-b36a-3a6a71363b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='397351f7f94b4532b2a7348db038b844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d90cdf53-692b-47a8-b0f4-722e7a5c2817,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:20:06Z,use_quota=True,user_id='ca70ed3763704364a457fb627634aaf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:20:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1306658-cb0f-47de-a133-821933ae5a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:20:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1306658-cb0f-47de-a133-821933ae5a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:20:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc587e77-a61c-4972-8a99-dc2f4a4dc5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:20:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc587e77-a61c-4972-8a99-dc2f4a4dc5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '06d82867-5d4a-4076-b36a-3a6a71363b9c', 'volume_name': 'volume-06d82867-5d4a-4076-b36a-3a6a71363b9c', 'volume_size': 1, 'snapshot_id': 'd90cdf53-692b-47a8-b0f4-722e7a5c2817'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:20:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f90ca4-9b17-40d6-91e3-3602d2aa45a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f90ca4-9b17-40d6-91e3-3602d2aa45a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aae2dde-dc00-40c7-a7cc-c48d6316598f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:20:06 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Volume 06d82867-5d4a-4076-b36a-3a6a71363b9c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-06d82867-5d4a-4076-b36a-3a6a71363b9c', 'volume_size': 1, 'snapshot_id': 'd90cdf53-692b-47a8-b0f4-722e7a5c2817'}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Acquiring lock "cinder-quobyte-d90cdf53-692b-47a8-b0f4-722e7a5c2817-06d82867-5d4a-4076-b36a-3a6a71363b9c" by "_create_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-quobyte-d90cdf53-692b-47a8-b0f4-722e7a5c2817-06d82867-5d4a-4076-b36a-3a6a71363b9c" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Creating volume 06d82867-5d4a-4076-b36a-3a6a71363b9c from snapshot d90cdf53-692b-47a8-b0f4-722e7a5c2817 {{(pid=86581) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Acquiring lock "cinder-quobyte-06d82867-5d4a-4076-b36a-3a6a71363b9c" by "_copy_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Attempting download of 1cdfafc2-9626-4888-834e-0c5644eadff7 ((None, [{'url': 'file:///opt/stack/data/glance/images/1cdfafc2-9626-4888-834e-0c5644eadff7', 'metadata': {}}])) to volume d77c095d-5d16-4bbb-9bf6-a376c3a6541d. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-quobyte-06d82867-5d4a-4076-b36a-3a6a71363b9c" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] snapshot: d90cdf53-692b-47a8-b0f4-722e7a5c2817, volume: 06d82867-5d4a-4076-b36a-3a6a71363b9c,  {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb62d367-ceba-4957-a2b7-8911f877be81]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cdfafc2-9626-4888-834e-0c5644eadff7_lida1vjl {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35eaa10-2dc8-4538-9c7e-713b0163da78]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:06 devstack sudo[102005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cdfafc2-9626-4888-834e-0c5644eadff7_lida1vjl
Jun 06 01:20:06 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:06 devstack sudo[102006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817
Jun 06 01:20:06 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:06 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cdfafc2-9626-4888-834e-0c5644eadff7_lida1vjl" returned: 0 in 0.666s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cdfafc2-9626-4888-834e-0c5644eadff7_lida1vjl {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:06 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817" returned: 0 in 0.721s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a45778e9-057a-48f1-a1de-3879c94ac9dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Creating direct copy from snapshot {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c77f4f4-7c2c-4d37-ba4a-832aa6296aea]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:20:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:06 devstack sudo[102014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cdfafc2-9626-4888-834e-0c5644eadff7_lida1vjl
Jun 06 01:20:06 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:06 devstack sudo[102015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc
Jun 06 01:20:06 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:07 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cdfafc2-9626-4888-834e-0c5644eadff7_lida1vjl" returned: 1 in 0.661s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cdfafc2-9626-4888-834e-0c5644eadff7_lida1vjl' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:20:07 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[922504d6-768b-4c29-9985-4162e029de2c]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:20:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdfafc2-9626-4888-834e-0c5644eadff7_jopqzowudevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:07 devstack sudo[102021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdfafc2-9626-4888-834e-0c5644eadff7_jopqzowudevstack@QuobyteHD
Jun 06 01:20:07 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:07 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc" returned: 0 in 0.728s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:07 devstack cinder-volume[86581]: DEBUG cinder.utils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Path /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-06d82867-5d4a-4076-b36a-3a6a71363b9c not found in is_blk_device check {{(pid=86581) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jun 06 01:20:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-06d82867-5d4a-4076-b36a-3a6a71363b9c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:07 devstack sudo[102025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-06d82867-5d4a-4076-b36a-3a6a71363b9c
Jun 06 01:20:07 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:08 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cdfafc2-9626-4888-834e-0c5644eadff7_jopqzowudevstack@QuobyteHD" returned: 0 in 0.690s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:08 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] 1cdfafc2-9626-4888-834e-0c5644eadff7 was qcow2, converting to raw {{(pid=86581) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jun 06 01:20:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cdfafc2-9626-4888-834e-0c5644eadff7_jopqzowudevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:08 devstack sudo[102033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cdfafc2-9626-4888-834e-0c5644eadff7_jopqzowudevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d
Jun 06 01:20:08 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:11 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cdfafc2-9626-4888-834e-0c5644eadff7_jopqzowudevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d" returned: 0 in 3.586s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:11 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1cdfafc2-9626-4888-834e-0c5644eadff7_jopqzowudevstack@QuobyteHD, size 112.00 MB, duration 3.59 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:20:11 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Converted 112.00 MB image at 31.22 MB/s
Jun 06 01:20:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:11 devstack sudo[102054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d 1G
Jun 06 01:20:11 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:12 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-06d82867-5d4a-4076-b36a-3a6a71363b9c" returned: 0 in 5.051s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:12 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c65bb2-afe1-4198-aabc-1890b55bddc1]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:20:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:12 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d 1G" returned: 0 in 1.004s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:12 devstack sudo[102059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc
Jun 06 01:20:12 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:12 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[2363119b-e429-4ed5-93ab-8ce361a1f09b]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:20:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:12 devstack sudo[102061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d
Jun 06 01:20:12 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:13 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:13 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d" returned: 0 in 0.708s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc" returned: 0 in 0.839s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:13 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Image conversion details: src /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-06d82867-5d4a-4076-b36a-3a6a71363b9c {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:20:13 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Converted 1024.00 MB image at 202.70 MB/s
Jun 06 01:20:13 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-06d82867-5d4a-4076-b36a-3a6a71363b9c is being set with open permissions: ugo+rw
Jun 06 01:20:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-06d82867-5d4a-4076-b36a-3a6a71363b9c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:13 devstack sudo[102070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-06d82867-5d4a-4076-b36a-3a6a71363b9c
Jun 06 01:20:13 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:13 devstack sudo[102069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d
Jun 06 01:20:13 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:14 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-06d82867-5d4a-4076-b36a-3a6a71363b9c" returned: 0 in 0.559s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-quobyte-06d82867-5d4a-4076-b36a-3a6a71363b9c" released by "_copy_volume_from_snapshot" :: held 8.010s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-quobyte-d90cdf53-692b-47a8-b0f4-722e7a5c2817-06d82867-5d4a-4076-b36a-3a6a71363b9c" released by "_create_volume_from_snapshot" :: held 8.047s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.068s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aae2dde-dc00-40c7-a7cc-c48d6316598f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06d82867-5d4a-4076-b36a-3a6a71363b9c', 'volume_size': 1, 'snapshot_id': 'd90cdf53-692b-47a8-b0f4-722e7a5c2817'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8954edb-41da-4571-9dd8-7b498d1c9abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:20:14 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Volume volume-06d82867-5d4a-4076-b36a-3a6a71363b9c (06d82867-5d4a-4076-b36a-3a6a71363b9c): created successfully
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8954edb-41da-4571-9dd8-7b498d1c9abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Flow 'volume_create_manager' (2ceb83ff-35fe-4eba-91fc-f880ab5a9960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:20:14 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-25122c68-66f5-4fb6-873a-316ba214fd3c tempest-SnapshotDependencyTests-269699442 None] Created volume successfully.
Jun 06 01:20:14 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d" returned: 1 in 0.688s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Downloaded image 1cdfafc2-9626-4888-834e-0c5644eadff7 ((None, [{'url': 'file:///opt/stack/data/glance/images/1cdfafc2-9626-4888-834e-0c5644eadff7', 'metadata': {}}])) to volume d77c095d-5d16-4bbb-9bf6-a376c3a6541d successfully. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Temporary image 1cdfafc2-9626-4888-834e-0c5644eadff7 for user 1d69e104485144699714f17f98d56d92 is deleted. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Marking volume d77c095d-5d16-4bbb-9bf6-a376c3a6541d as bootable. {{(pid=86581) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Copying metadata from image 1cdfafc2-9626-4888-834e-0c5644eadff7 to d77c095d-5d16-4bbb-9bf6-a376c3a6541d. {{(pid=86581) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Creating volume glance metadata for volume d77c095d-5d16-4bbb-9bf6-a376c3a6541d backed by image 1cdfafc2-9626-4888-834e-0c5644eadff7 with: {'image_id': '1cdfafc2-9626-4888-834e-0c5644eadff7', 'image_name': 'tempest-scenario-img--145688281', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86581) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8557c6a-20cf-434c-90f0-acebb0746607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d', 'volume_size': 1, 'image_id': '1cdfafc2-9626-4888-834e-0c5644eadff7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cdfafc2-9626-4888-834e-0c5644eadff7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--145688281', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd9ab18d086c74c179b719f5c7eda3e5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cdfafc2-9626-4888-834e-0c5644eadff7', 'created_at': datetime.datetime(2026, 6, 5, 23, 19, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 23, 19, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cdfafc2-9626-4888-834e-0c5644eadff7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2d1fa70>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af415ae7-28e6-47d4-a70c-db0435093597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:20:14 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Volume volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d (d77c095d-5d16-4bbb-9bf6-a376c3a6541d): created successfully
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af415ae7-28e6-47d4-a70c-db0435093597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Flow 'volume_create_manager' (a470059c-39d2-4be5-ae1c-dfa724b4e4b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:20:14 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-cefc1f5b-eb87-4d26-a856-2c3f97f0010c tempest-TestInstancesWithCinderVolumes-969883898 None] Created volume successfully.
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] Acquiring lock "cinder-d90cdf53-692b-47a8-b0f4-722e7a5c2817-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-d90cdf53-692b-47a8-b0f4-722e7a5c2817-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] Acquiring lock "cinder-quobyte-a45778e9-057a-48f1-a1de-3879c94ac9dc" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-quobyte-a45778e9-057a-48f1-a1de-3879c94ac9dc" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] Acquiring lock "cinder-quobyte-d90cdf53-692b-47a8-b0f4-722e7a5c2817" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-quobyte-d90cdf53-692b-47a8-b0f4-722e7a5c2817" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] Deleting offline snapshot d90cdf53-692b-47a8-b0f4-722e7a5c2817 of volume a45778e9-057a-48f1-a1de-3879c94ac9dc {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] snapshot_file for this snap is: volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[617e1c16-52a3-4cff-abe6-3047589548d2]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:20:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:15 devstack sudo[102114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817
Jun 06 01:20:15 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:15 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817" returned: 0 in 0.748s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a45778e9-057a-48f1-a1de-3879c94ac9dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:20:15 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d04b09-c089-4fef-93c1-ab932386e7c9]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:20:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:15 devstack sudo[102124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc
Jun 06 01:20:15 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:16 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc" returned: 0 in 0.728s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:16 devstack sudo[102129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817
Jun 06 01:20:16 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:17 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817" returned: 0 in 0.704s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:17 devstack sudo[102143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817
Jun 06 01:20:17 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:17 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc.d90cdf53-692b-47a8-b0f4-722e7a5c2817" returned: 0 in 0.619s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-quobyte-d90cdf53-692b-47a8-b0f4-722e7a5c2817" released by "_delete_snapshot" :: held 2.906s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:20:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-quobyte-a45778e9-057a-48f1-a1de-3879c94ac9dc" released by "delete_snapshot" :: held 2.937s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:20:17 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] Created reservations ['bebfbc39-879e-40e8-8857-181d9c12affb', 'cc27bff6-95fe-453e-a47d-7e7ec83a5b92', '8bb3fb56-1053-4274-8ab9-a91145eb0599', '56640232-388d-45cd-8fbf-4e07fc05d4fe'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:20:17 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] Delete snapshot completed successfully.
Jun 06 01:20:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8b501b4f-dc97-4e97-89af-7747b817f288 tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-d90cdf53-692b-47a8-b0f4-722e7a5c2817-delete_snapshot" released by "delete_snapshot" :: held 3.064s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:20:18 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] Acquiring lock "cinder-a45778e9-057a-48f1-a1de-3879c94ac9dc-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:20:18 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-a45778e9-057a-48f1-a1de-3879c94ac9dc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:20:18 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] Acquiring lock "cinder-quobyte-a45778e9-057a-48f1-a1de-3879c94ac9dc" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:20:18 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-quobyte-a45778e9-057a-48f1-a1de-3879c94ac9dc" acquired by "delete_volume" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:20:18 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[82871967-218a-42a0-9629-4a3a32c37876]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:20:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:18 devstack sudo[102146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc
Jun 06 01:20:18 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:18 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc" returned: 0 in 0.721s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:18 devstack sudo[102151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc
Jun 06 01:20:18 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:19 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a45778e9-057a-48f1-a1de-3879c94ac9dc" returned: 0 in 0.598s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-quobyte-a45778e9-057a-48f1-a1de-3879c94ac9dc" released by "delete_volume" :: held 1.379s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:20:19 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] Created reservations ['47941aee-d430-4030-98a4-5344db391184', 'f25bf27c-9d10-454c-ac8a-6e0a421393ac', '11be5f69-70e8-4713-9e17-c2aa5c3041d2', 'd4b318bd-f251-492e-b4ea-859b966d6d1e'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:20:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:20:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:20:19 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:20:19 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:20:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:20:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:19 devstack sudo[102154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:20:19 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:20 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.614s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:20 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:20:20 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] Deleted volume successfully.
Jun 06 01:20:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f573f071-8f92-4ab5-9774-231e3dcf7de4 tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-a45778e9-057a-48f1-a1de-3879c94ac9dc-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:20:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] Acquiring lock "cinder-06d82867-5d4a-4076-b36a-3a6a71363b9c-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:20:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-06d82867-5d4a-4076-b36a-3a6a71363b9c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:20:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] Acquiring lock "cinder-quobyte-06d82867-5d4a-4076-b36a-3a6a71363b9c" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:20:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-quobyte-06d82867-5d4a-4076-b36a-3a6a71363b9c" acquired by "delete_volume" :: waited 0.024s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:20:20 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ba1ffc-a482-4c86-8c10-23d76a04d970]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:20:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-06d82867-5d4a-4076-b36a-3a6a71363b9c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:20 devstack sudo[102157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-06d82867-5d4a-4076-b36a-3a6a71363b9c
Jun 06 01:20:20 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:21 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-06d82867-5d4a-4076-b36a-3a6a71363b9c" returned: 0 in 0.792s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-06d82867-5d4a-4076-b36a-3a6a71363b9c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:21 devstack sudo[102162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-06d82867-5d4a-4076-b36a-3a6a71363b9c
Jun 06 01:20:21 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-dc3054c0-a021-499d-822c-319785858ca4 req-2a76a11d-5f4e-4944-bb72-c226d572eaf1 tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:20:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-dc3054c0-a021-499d-822c-319785858ca4 req-2a76a11d-5f4e-4944-bb72-c226d572eaf1 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:20:21 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9e5005-b890-4a3e-98df-0987b327fee8]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:20:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-dc3054c0-a021-499d-822c-319785858ca4 req-2a76a11d-5f4e-4944-bb72-c226d572eaf1 tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:21 devstack sudo[102173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d
Jun 06 01:20:21 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:21 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-06d82867-5d4a-4076-b36a-3a6a71363b9c" returned: 0 in 0.684s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-quobyte-06d82867-5d4a-4076-b36a-3a6a71363b9c" released by "delete_volume" :: held 1.525s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:20:21 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] Created reservations ['9ea5d622-1c37-431f-90d9-b3fc00ed605d', '998f77f6-a232-4ed2-9c75-e6022eb25b59', '8d2246ed-1698-489c-a1c6-547243e4ea45', '67c76c15-1d65-40cb-96ea-34d0161c7240'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:20:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:20:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:20:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:20:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:20:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:20:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:22 devstack sudo[102176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:20:22 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:22 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-dc3054c0-a021-499d-822c-319785858ca4 req-2a76a11d-5f4e-4944-bb72-c226d572eaf1 tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d" returned: 0 in 0.734s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-dc3054c0-a021-499d-822c-319785858ca4 req-2a76a11d-5f4e-4944-bb72-c226d572eaf1 tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:22 devstack sudo[102180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d
Jun 06 01:20:22 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:22 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.661s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:22 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:20:22 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] Deleted volume successfully.
Jun 06 01:20:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7a91e40b-d33a-4097-94dd-7f14cea493f7 tempest-SnapshotDependencyTests-269699442 None] Lock "cinder-06d82867-5d4a-4076-b36a-3a6a71363b9c-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:20:23 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-dc3054c0-a021-499d-822c-319785858ca4 req-2a76a11d-5f4e-4944-bb72-c226d572eaf1 tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d" returned: 1 in 0.729s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-dc3054c0-a021-499d-822c-319785858ca4 req-2a76a11d-5f4e-4944-bb72-c226d572eaf1 tempest-TestInstancesWithCinderVolumes-969883898 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:20:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-dc3054c0-a021-499d-822c-319785858ca4 req-2a76a11d-5f4e-4944-bb72-c226d572eaf1 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.502s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:20:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-dc3054c0-a021-499d-822c-319785858ca4 req-2a76a11d-5f4e-4944-bb72-c226d572eaf1 tempest-TestInstancesWithCinderVolumes-969883898 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d4d0ceb-d54c-43a7-8bbc-9453ca8bc5b0', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:20:23 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-dc3054c0-a021-499d-822c-319785858ca4 req-2a76a11d-5f4e-4944-bb72-c226d572eaf1 tempest-TestInstancesWithCinderVolumes-969883898 None] attachment_update completed successfully.
Jun 06 01:20:33 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=41,cinder:SELECT=36,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:20:33 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=45,cinder:UPDATE=39,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:20:49 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=1 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:20:49 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=1 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:20:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:20:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:20:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:20:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:20:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:20:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:20:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:59 devstack sudo[102753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:20:59 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:20:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-a0672ce9-55ef-4e50-8388-794dbf45a418 req-7d9522ac-2cf4-409d-9f12-4a07add29305 tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:20:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-a0672ce9-55ef-4e50-8388-794dbf45a418 req-7d9522ac-2cf4-409d-9f12-4a07add29305 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:20:59 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9ca711-a1dd-49d8-abb3-f6b57b508781]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:20:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-a0672ce9-55ef-4e50-8388-794dbf45a418 req-7d9522ac-2cf4-409d-9f12-4a07add29305 tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:20:59 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root
Jun 06 01:20:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.617s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:20:59 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:21:00 devstack sudo[102764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e
Jun 06 01:21:00 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:21:00 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root
Jun 06 01:21:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-a0672ce9-55ef-4e50-8388-794dbf45a418 req-7d9522ac-2cf4-409d-9f12-4a07add29305 tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e" returned: 0 in 0.702s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:21:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-a0672ce9-55ef-4e50-8388-794dbf45a418 req-7d9522ac-2cf4-409d-9f12-4a07add29305 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.727s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:21:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-a0672ce9-55ef-4e50-8388-794dbf45a418 req-7d9522ac-2cf4-409d-9f12-4a07add29305 tempest-TestInstancesWithCinderVolumes-969883898 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c16ba9cc-7531-4c26-bab4-6a4b2ff32852', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:21:00 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-a0672ce9-55ef-4e50-8388-794dbf45a418 req-7d9522ac-2cf4-409d-9f12-4a07add29305 tempest-TestInstancesWithCinderVolumes-969883898 None] attachment_update completed successfully.
Jun 06 01:21:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-40a132d2-baae-4789-80b5-54b165370496 req-7287ef64-92ed-4169-a454-9fee8194a988 tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:21:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-40a132d2-baae-4789-80b5-54b165370496 req-7287ef64-92ed-4169-a454-9fee8194a988 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:21:08 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10a6058-2ced-47b2-8d68-1345ce7626c7]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:21:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-40a132d2-baae-4789-80b5-54b165370496 req-7287ef64-92ed-4169-a454-9fee8194a988 tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-945a13f4-03ef-4224-9881-145aa4193e91 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:21:08 devstack sudo[102790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-945a13f4-03ef-4224-9881-145aa4193e91
Jun 06 01:21:08 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:21:09 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root
Jun 06 01:21:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-40a132d2-baae-4789-80b5-54b165370496 req-7287ef64-92ed-4169-a454-9fee8194a988 tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-945a13f4-03ef-4224-9881-145aa4193e91" returned: 0 in 0.688s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:21:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-40a132d2-baae-4789-80b5-54b165370496 req-7287ef64-92ed-4169-a454-9fee8194a988 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.704s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:21:09 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-40a132d2-baae-4789-80b5-54b165370496 req-7287ef64-92ed-4169-a454-9fee8194a988 tempest-TestInstancesWithCinderVolumes-969883898 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-945a13f4-03ef-4224-9881-145aa4193e91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fb20cf6-a33a-4d8f-8029-9b16d06704c5', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:21:09 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-40a132d2-baae-4789-80b5-54b165370496 req-7287ef64-92ed-4169-a454-9fee8194a988 tempest-TestInstancesWithCinderVolumes-969883898 None] attachment_update completed successfully.
Jun 06 01:21:17 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-13acbca1-d115-4a47-acf9-0fc7af430264 req-c3072779-0030-4719-81f3-a31f35e386d0 tempest-TestInstancesWithCinderVolumes-969883898 None] Terminate volume connection completed successfully.
Jun 06 01:21:17 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-13acbca1-d115-4a47-acf9-0fc7af430264 req-c3072779-0030-4719-81f3-a31f35e386d0 tempest-TestInstancesWithCinderVolumes-969883898 None] Deleting attachment c16ba9cc-7531-4c26-bab4-6a4b2ff32852. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:21:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "cinder-1244ddb7-bc8d-47aa-b00a-f472ac60275e-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:21:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "cinder-1244ddb7-bc8d-47aa-b00a-f472ac60275e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:21:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "cinder-quobyte-1244ddb7-bc8d-47aa-b00a-f472ac60275e" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:21:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "cinder-quobyte-1244ddb7-bc8d-47aa-b00a-f472ac60275e" acquired by "delete_volume" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:21:19 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d78e3ad-3021-4211-a688-3d777c93241b]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:21:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:21:19 devstack sudo[102876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e
Jun 06 01:21:19 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:21:20 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root
Jun 06 01:21:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e" returned: 0 in 0.746s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:21:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:21:20 devstack sudo[102881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e
Jun 06 01:21:20 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:21:20 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root
Jun 06 01:21:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-1244ddb7-bc8d-47aa-b00a-f472ac60275e" returned: 0 in 0.622s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:21:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "cinder-quobyte-1244ddb7-bc8d-47aa-b00a-f472ac60275e" released by "delete_volume" :: held 1.411s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:21:20 devstack cinder-volume[86581]: WARNING cinder.quota [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1378552829-233493597 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1378552829-233493597, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:21:20 devstack cinder-volume[86581]: WARNING cinder.quota [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1378552829-233493597 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1378552829-233493597, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:21:20 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Created reservations ['d57b6c02-42a3-4356-a986-6a60240671a5', '52f44a02-0ebb-4b96-bb64-49cf73875651', 'c9d6dd9d-7d42-4f31-a391-ebd42ea19b17', 'a1e0fd81-3ec1-4bb7-a7d4-c9c6f0b1e760'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:21:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:21:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:21:21 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:21:21 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:21:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:21:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:21:21 devstack sudo[102884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:21:21 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:21:21 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root
Jun 06 01:21:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.611s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:21:21 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:21:21 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Deleted volume successfully.
Jun 06 01:21:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-e0067875-fa19-4566-a110-22a76a369301 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "cinder-1244ddb7-bc8d-47aa-b00a-f472ac60275e-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:21:23 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-36387a81-a42e-475f-b564-652b3724a63e req-462f97b8-acb8-476d-90a7-bd6f316d1ea3 tempest-TestInstancesWithCinderVolumes-969883898 None] Terminate volume connection completed successfully.
Jun 06 01:21:23 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-36387a81-a42e-475f-b564-652b3724a63e req-462f97b8-acb8-476d-90a7-bd6f316d1ea3 tempest-TestInstancesWithCinderVolumes-969883898 None] Deleting attachment 5fb20cf6-a33a-4d8f-8029-9b16d06704c5. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:21:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "cinder-945a13f4-03ef-4224-9881-145aa4193e91-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:21:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "cinder-945a13f4-03ef-4224-9881-145aa4193e91-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:21:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "cinder-quobyte-945a13f4-03ef-4224-9881-145aa4193e91" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:21:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "cinder-quobyte-945a13f4-03ef-4224-9881-145aa4193e91" acquired by "delete_volume" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:21:25 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ce00a1-7be9-4fa3-8b91-f393024f3cbc]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:21:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-945a13f4-03ef-4224-9881-145aa4193e91 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:21:25 devstack sudo[102912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-945a13f4-03ef-4224-9881-145aa4193e91
Jun 06 01:21:25 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:21:26 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root
Jun 06 01:21:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-945a13f4-03ef-4224-9881-145aa4193e91" returned: 0 in 0.744s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:21:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-945a13f4-03ef-4224-9881-145aa4193e91 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:21:26 devstack sudo[102920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-945a13f4-03ef-4224-9881-145aa4193e91
Jun 06 01:21:26 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:21:27 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root
Jun 06 01:21:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-945a13f4-03ef-4224-9881-145aa4193e91" returned: 0 in 0.634s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:21:27 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "cinder-quobyte-945a13f4-03ef-4224-9881-145aa4193e91" released by "delete_volume" :: held 1.433s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:21:27 devstack cinder-volume[86581]: WARNING cinder.quota [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-997800274-1760488161 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-997800274-1760488161, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:21:27 devstack cinder-volume[86581]: WARNING cinder.quota [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-997800274-1760488161 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-997800274-1760488161, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:21:27 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Created reservations ['eeb06313-7911-46de-aa89-1177375aa788', '03311eee-401f-481c-9b84-347383d7e435', 'c2c39e7f-2153-4c60-9d19-0c1408793487', '60e5c83a-e894-4df1-9b78-73ea0a4c2481'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:21:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:21:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:21:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:21:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:21:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:21:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:21:27 devstack sudo[102924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:21:27 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:21:27 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root
Jun 06 01:21:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.684s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:21:27 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:21:27 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Deleted volume successfully.
Jun 06 01:21:27 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0eb0ad42-8430-4f5f-b2e8-918b1ffcd5dc tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "cinder-945a13f4-03ef-4224-9881-145aa4193e91-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:21:31 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-0256d383-7c9c-4e3a-9e31-39b59418364e req-8e4c5f9d-8769-47e8-8a7d-87df04ddd81b tempest-TestInstancesWithCinderVolumes-969883898 None] Terminate volume connection completed successfully.
Jun 06 01:21:31 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-0256d383-7c9c-4e3a-9e31-39b59418364e req-8e4c5f9d-8769-47e8-8a7d-87df04ddd81b tempest-TestInstancesWithCinderVolumes-969883898 None] Deleting attachment 1d4d0ceb-d54c-43a7-8bbc-9453ca8bc5b0. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:21:34 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "cinder-d77c095d-5d16-4bbb-9bf6-a376c3a6541d-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:21:34 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "cinder-d77c095d-5d16-4bbb-9bf6-a376c3a6541d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:21:34 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "cinder-quobyte-d77c095d-5d16-4bbb-9bf6-a376c3a6541d" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:21:34 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "cinder-quobyte-d77c095d-5d16-4bbb-9bf6-a376c3a6541d" acquired by "delete_volume" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:21:34 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cbe386-497e-40c6-81c0-22699d0f5ea9]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:21:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:21:35 devstack sudo[102973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d
Jun 06 01:21:35 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:21:35 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root
Jun 06 01:21:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d" returned: 0 in 0.706s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:21:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:21:35 devstack sudo[102977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d
Jun 06 01:21:35 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:21:36 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root
Jun 06 01:21:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d" returned: 1 in 0.690s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:21:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:21:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:21:36 devstack sudo[102982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d
Jun 06 01:21:36 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:21:36 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root
Jun 06 01:21:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d77c095d-5d16-4bbb-9bf6-a376c3a6541d" returned: 0 in 0.602s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:21:36 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "cinder-quobyte-d77c095d-5d16-4bbb-9bf6-a376c3a6541d" released by "delete_volume" :: held 2.064s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:21:36 devstack cinder-volume[86581]: WARNING cinder.quota [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1534189584-806351639 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1534189584-806351639, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:21:36 devstack cinder-volume[86581]: WARNING cinder.quota [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1534189584-806351639 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1534189584-806351639, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:21:36 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Created reservations ['4a2439a0-934a-4cbb-a031-8818c3da7e17', '72cff36f-640e-45a9-889f-2fca169e4f88', '84b1b6c2-8bc0-4b3a-9967-7a0051cca8b8', '15b032ce-1206-4863-9bb9-eb2694784290'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:21:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:21:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:21:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:21:37 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:21:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:21:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:21:37 devstack sudo[102985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:21:37 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:21:37 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root
Jun 06 01:21:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.592s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:21:37 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:21:37 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Deleted volume successfully.
Jun 06 01:21:37 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-2ada7009-07d2-4b2b-a8eb-2dd6c3f9d328 tempest-TestInstancesWithCinderVolumes-969883898 None] Lock "cinder-d77c095d-5d16-4bbb-9bf6-a376c3a6541d-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:21:47 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=23,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:21:47 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=35,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:21:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:21:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:21:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:21:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:21:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:21:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:21:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:21:59 devstack sudo[102996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:21:59 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:21:59 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root
Jun 06 01:21:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.596s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:21:59 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:22:10 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:22:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Flow 'volume_create_manager' (2c131a0a-5028-4ab1-8e96-d22d6ceb3b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:22:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f7227d-eec7-49d6-9c22-9f013b0bfcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:22:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f7227d-eec7-49d6-9c22-9f013b0bfcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1477683301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01359a17-7e2b-4b0a-8018-76005650c147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f17355b66dc4603b68badde64e2f624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:22:10Z,use_quota=True,user_id='d38af40c5ea84c94bc0d1aa9bc55fac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:22:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de62478e-e89c-4369-8f85-adf8b7ee46df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:22:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de62478e-e89c-4369-8f85-adf8b7ee46df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:22:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239ce387-4a7e-4303-899a-262886bf1a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:22:10 devstack cinder-volume[86581]: DEBUG cinder.image.glance [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Creating Keystone auth plugin from conf {{(pid=86581) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 06 01:22:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239ce387-4a7e-4303-899a-262886bf1a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01359a17-7e2b-4b0a-8018-76005650c147', 'volume_name': 'volume-01359a17-7e2b-4b0a-8018-76005650c147', 'volume_size': 1, 'image_id': '072119e4-dec9-4da3-882b-9b4b26824482', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30202bd94f9947968da8019925562da0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '072119e4-dec9-4da3-882b-9b4b26824482', 'created_at': datetime.datetime(2026, 6, 5, 22, 55, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 22, 55, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072119e4-dec9-4da3-882b-9b4b26824482/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2d63fb0>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:22:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b54534e-9975-477c-b97a-482e62cdbb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:22:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b54534e-9975-477c-b97a-482e62cdbb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:22:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66edf2a-b934-4c7f-a2be-282d01e5aa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:22:10 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Volume 01359a17-7e2b-4b0a-8018-76005650c147: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01359a17-7e2b-4b0a-8018-76005650c147', 'volume_size': 1, 'image_id': '072119e4-dec9-4da3-882b-9b4b26824482', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30202bd94f9947968da8019925562da0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '072119e4-dec9-4da3-882b-9b4b26824482', 'created_at': datetime.datetime(2026, 6, 5, 22, 55, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 22, 55, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072119e4-dec9-4da3-882b-9b4b26824482/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2d63fb0>}
Jun 06 01:22:10 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Trying to clone 01359a17-7e2b-4b0a-8018-76005650c147 from image 072119e4-dec9-4da3-882b-9b4b26824482 at location (None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}]). {{(pid=86581) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Jun 06 01:22:10 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_t59ib8w0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jun 06 01:22:10 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Image download 20.69 MB at 20.69 MB/s
Jun 06 01:22:10 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd09945d-c9c2-40bc-a47e-2398804ee1a1]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:22:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_t59ib8w0devstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:22:10 devstack sudo[103001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_t59ib8w0devstack@QuobyteHD
Jun 06 01:22:10 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:22:11 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root
Jun 06 01:22:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_t59ib8w0devstack@QuobyteHD" returned: 0 in 0.700s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:22:11 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Temporary image 072119e4-dec9-4da3-882b-9b4b26824482 is fetched for user d38af40c5ea84c94bc0d1aa9bc55fac4. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jun 06 01:22:11 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[c445877a-4b06-47d9-bf87-14b23cd9fcac]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:22:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_t59ib8w0devstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:22:11 devstack sudo[103006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_t59ib8w0devstack@QuobyteHD
Jun 06 01:22:11 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:22:12 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root
Jun 06 01:22:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_t59ib8w0devstack@QuobyteHD" returned: 0 in 0.676s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:22:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:22:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:22:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1477683301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01359a17-7e2b-4b0a-8018-76005650c147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f17355b66dc4603b68badde64e2f624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:22:10Z,use_quota=True,user_id='d38af40c5ea84c94bc0d1aa9bc55fac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:22:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Creating volume 01359a17-7e2b-4b0a-8018-76005650c147 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:22:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:22:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:22:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:22:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:22:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:22:12 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:22:12 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:22:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:22:12 devstack sudo[103011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 1073741824
Jun 06 01:22:12 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:22:13 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root
Jun 06 01:22:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 1073741824" returned: 0 in 0.787s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:22:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:22:13 devstack sudo[103016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147
Jun 06 01:22:13 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:22:13 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root
Jun 06 01:22:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147" returned: 0 in 0.623s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:22:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:22:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:22:13 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Attempting download of 072119e4-dec9-4da3-882b-9b4b26824482 ((None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}])) to volume 01359a17-7e2b-4b0a-8018-76005650c147. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jun 06 01:22:13 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ceba05-ce64-4987-97b6-653c02c42248]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:22:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_3araat2d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:22:13 devstack sudo[103020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_3araat2d
Jun 06 01:22:13 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:22:14 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root
Jun 06 01:22:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_3araat2d" returned: 0 in 0.664s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:22:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_3araat2d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:22:14 devstack sudo[103024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_3araat2d
Jun 06 01:22:14 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:22:15 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root
Jun 06 01:22:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_3araat2d" returned: 1 in 0.669s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:22:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072119e4-dec9-4da3-882b-9b4b26824482_3araat2d' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:22:15 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[40655216-2b95-462e-8acc-55a68a21ddd0]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:22:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_t59ib8w0devstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:22:15 devstack sudo[103028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_t59ib8w0devstack@QuobyteHD
Jun 06 01:22:15 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:22:15 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root
Jun 06 01:22:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_t59ib8w0devstack@QuobyteHD" returned: 0 in 0.671s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:22:15 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] 072119e4-dec9-4da3-882b-9b4b26824482 was qcow2, converting to raw {{(pid=86581) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jun 06 01:22:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_t59ib8w0devstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:22:15 devstack sudo[103067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_t59ib8w0devstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147
Jun 06 01:22:15 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:22:17 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root
Jun 06 01:22:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_t59ib8w0devstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147" returned: 0 in 1.690s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:22:17 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_072119e4-dec9-4da3-882b-9b4b26824482_t59ib8w0devstack@QuobyteHD, size 112.00 MB, duration 1.69 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:22:17 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Converted 112.00 MB image at 66.21 MB/s
Jun 06 01:22:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:22:17 devstack sudo[103084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 1G
Jun 06 01:22:17 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:22:18 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root
Jun 06 01:22:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 1G" returned: 0 in 0.632s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:22:18 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c18d53-b698-42d7-a1ec-ea6c320bded4]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:22:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:22:18 devstack sudo[103089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147
Jun 06 01:22:18 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:22:18 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root
Jun 06 01:22:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147" returned: 0 in 0.694s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:22:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:22:18 devstack sudo[103093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147
Jun 06 01:22:18 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:22:19 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root
Jun 06 01:22:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147" returned: 1 in 0.708s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:22:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:22:19 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Downloaded image 072119e4-dec9-4da3-882b-9b4b26824482 ((None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}])) to volume 01359a17-7e2b-4b0a-8018-76005650c147 successfully. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jun 06 01:22:19 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Temporary image 072119e4-dec9-4da3-882b-9b4b26824482 for user d38af40c5ea84c94bc0d1aa9bc55fac4 is deleted. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jun 06 01:22:19 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Marking volume 01359a17-7e2b-4b0a-8018-76005650c147 as bootable. {{(pid=86581) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jun 06 01:22:19 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Copying metadata from image 072119e4-dec9-4da3-882b-9b4b26824482 to 01359a17-7e2b-4b0a-8018-76005650c147. {{(pid=86581) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 06 01:22:19 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Creating volume glance metadata for volume 01359a17-7e2b-4b0a-8018-76005650c147 backed by image 072119e4-dec9-4da3-882b-9b4b26824482 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '072119e4-dec9-4da3-882b-9b4b26824482', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86581) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 06 01:22:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66edf2a-b934-4c7f-a2be-282d01e5aa7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01359a17-7e2b-4b0a-8018-76005650c147', 'volume_size': 1, 'image_id': '072119e4-dec9-4da3-882b-9b4b26824482', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072119e4-dec9-4da3-882b-9b4b26824482', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30202bd94f9947968da8019925562da0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '072119e4-dec9-4da3-882b-9b4b26824482', 'created_at': datetime.datetime(2026, 6, 5, 22, 55, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 22, 55, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072119e4-dec9-4da3-882b-9b4b26824482/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2d63fb0>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:22:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f182ead5-4658-4f8d-851a-80b3b424d225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:22:19 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Volume volume-01359a17-7e2b-4b0a-8018-76005650c147 (01359a17-7e2b-4b0a-8018-76005650c147): created successfully
Jun 06 01:22:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f182ead5-4658-4f8d-851a-80b3b424d225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:22:19 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Flow 'volume_create_manager' (2c131a0a-5028-4ab1-8e96-d22d6ceb3b46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:22:19 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b5e7ba20-35c8-4ba6-a1ff-2845cbd86921 tempest-TestShelveInstance-1438614588 None] Created volume successfully.
Jun 06 01:22:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-b215ecba-c6a7-4dd3-93d5-487140d96286 req-09c4a8bc-bf0c-44a0-9173-ab243a8121b7 tempest-TestShelveInstance-1438614588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:22:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-b215ecba-c6a7-4dd3-93d5-487140d96286 req-09c4a8bc-bf0c-44a0-9173-ab243a8121b7 tempest-TestShelveInstance-1438614588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:22:27 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[4214f658-f92b-453d-b9f2-b491ecd2dd4e]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:22:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-b215ecba-c6a7-4dd3-93d5-487140d96286 req-09c4a8bc-bf0c-44a0-9173-ab243a8121b7 tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:22:27 devstack sudo[103116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147
Jun 06 01:22:27 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:22:28 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root
Jun 06 01:22:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-b215ecba-c6a7-4dd3-93d5-487140d96286 req-09c4a8bc-bf0c-44a0-9173-ab243a8121b7 tempest-TestShelveInstance-1438614588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147" returned: 0 in 0.720s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:22:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-b215ecba-c6a7-4dd3-93d5-487140d96286 req-09c4a8bc-bf0c-44a0-9173-ab243a8121b7 tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:22:28 devstack sudo[103120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147
Jun 06 01:22:28 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:22:29 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root
Jun 06 01:22:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-b215ecba-c6a7-4dd3-93d5-487140d96286 req-09c4a8bc-bf0c-44a0-9173-ab243a8121b7 tempest-TestShelveInstance-1438614588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147" returned: 1 in 0.710s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:22:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-b215ecba-c6a7-4dd3-93d5-487140d96286 req-09c4a8bc-bf0c-44a0-9173-ab243a8121b7 tempest-TestShelveInstance-1438614588 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:22:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-b215ecba-c6a7-4dd3-93d5-487140d96286 req-09c4a8bc-bf0c-44a0-9173-ab243a8121b7 tempest-TestShelveInstance-1438614588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.477s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:22:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-b215ecba-c6a7-4dd3-93d5-487140d96286 req-09c4a8bc-bf0c-44a0-9173-ab243a8121b7 tempest-TestShelveInstance-1438614588 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-01359a17-7e2b-4b0a-8018-76005650c147', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd20f1dff-c813-4f01-adf9-a300b6d32345', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:22:29 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-b215ecba-c6a7-4dd3-93d5-487140d96286 req-09c4a8bc-bf0c-44a0-9173-ab243a8121b7 tempest-TestShelveInstance-1438614588 None] attachment_update completed successfully.
Jun 06 01:22:39 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=6,cinder:INSERT=7,cinder:SELECT=13,cinder:DELETE=1 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:22:39 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=17,cinder:UPDATE=6,cinder:INSERT=7 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:22:49 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=1 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:22:49 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=1 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:22:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:22:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:22:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:22:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:22:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:22:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:22:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:22:59 devstack sudo[103672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:22:59 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:22:59 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root
Jun 06 01:22:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.612s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:22:59 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:23:05 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-d60f6e4d-efb7-480d-82be-a993d5d15ed6 req-cd1ce836-067f-49d6-b7a3-c48a78cfaefb tempest-TestShelveInstance-1438614588 None] Terminate volume connection completed successfully.
Jun 06 01:23:05 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-d60f6e4d-efb7-480d-82be-a993d5d15ed6 req-cd1ce836-067f-49d6-b7a3-c48a78cfaefb tempest-TestShelveInstance-1438614588 None] Deleting attachment d20f1dff-c813-4f01-adf9-a300b6d32345. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:23:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-1a130608-5f68-4dd9-b9c1-af51d5641d11 req-c9858b6b-a0f8-47be-acca-2c4bbcb149ad tempest-TestShelveInstance-1438614588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:23:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-1a130608-5f68-4dd9-b9c1-af51d5641d11 req-c9858b6b-a0f8-47be-acca-2c4bbcb149ad tempest-TestShelveInstance-1438614588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:23:10 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d04bbb4-492a-41ab-a2d9-2db00110fbf0]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:23:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-1a130608-5f68-4dd9-b9c1-af51d5641d11 req-c9858b6b-a0f8-47be-acca-2c4bbcb149ad tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:23:10 devstack sudo[103732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147
Jun 06 01:23:10 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:23:11 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root
Jun 06 01:23:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-1a130608-5f68-4dd9-b9c1-af51d5641d11 req-c9858b6b-a0f8-47be-acca-2c4bbcb149ad tempest-TestShelveInstance-1438614588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147" returned: 0 in 0.690s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:23:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-1a130608-5f68-4dd9-b9c1-af51d5641d11 req-c9858b6b-a0f8-47be-acca-2c4bbcb149ad tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:23:11 devstack sudo[103736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147
Jun 06 01:23:11 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:23:11 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root
Jun 06 01:23:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-1a130608-5f68-4dd9-b9c1-af51d5641d11 req-c9858b6b-a0f8-47be-acca-2c4bbcb149ad tempest-TestShelveInstance-1438614588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147" returned: 1 in 0.682s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:23:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-1a130608-5f68-4dd9-b9c1-af51d5641d11 req-c9858b6b-a0f8-47be-acca-2c4bbcb149ad tempest-TestShelveInstance-1438614588 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:23:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-1a130608-5f68-4dd9-b9c1-af51d5641d11 req-c9858b6b-a0f8-47be-acca-2c4bbcb149ad tempest-TestShelveInstance-1438614588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.411s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:23:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-1a130608-5f68-4dd9-b9c1-af51d5641d11 req-c9858b6b-a0f8-47be-acca-2c4bbcb149ad tempest-TestShelveInstance-1438614588 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-01359a17-7e2b-4b0a-8018-76005650c147', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49fc9631-5835-48a2-a314-931c03cc10cd', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:23:11 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-1a130608-5f68-4dd9-b9c1-af51d5641d11 req-c9858b6b-a0f8-47be-acca-2c4bbcb149ad tempest-TestShelveInstance-1438614588 None] attachment_update completed successfully.
Jun 06 01:23:21 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:23:21 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:23:51 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-dece5e02-a661-4256-a885-368148155e1f req-f8de64c8-3f08-4e11-bff4-6f1be6ea2301 tempest-TestShelveInstance-1438614588 None] Terminate volume connection completed successfully.
Jun 06 01:23:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-dece5e02-a661-4256-a885-368148155e1f req-f8de64c8-3f08-4e11-bff4-6f1be6ea2301 tempest-TestShelveInstance-1438614588 None] Deleting attachment 49fc9631-5835-48a2-a314-931c03cc10cd. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:23:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Acquiring lock "cinder-01359a17-7e2b-4b0a-8018-76005650c147-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:23:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Lock "cinder-01359a17-7e2b-4b0a-8018-76005650c147-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:23:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Acquiring lock "cinder-quobyte-01359a17-7e2b-4b0a-8018-76005650c147" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:23:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Lock "cinder-quobyte-01359a17-7e2b-4b0a-8018-76005650c147" acquired by "delete_volume" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:23:52 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[26639cac-f55e-4a42-94af-62b2137919da]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:23:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:23:52 devstack sudo[104319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147
Jun 06 01:23:52 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:23:52 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root
Jun 06 01:23:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147" returned: 0 in 0.696s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:23:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:23:52 devstack sudo[104323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147
Jun 06 01:23:52 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:23:53 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root
Jun 06 01:23:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147" returned: 1 in 0.675s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:23:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:23:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:23:53 devstack sudo[104329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147
Jun 06 01:23:53 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:23:53 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root
Jun 06 01:23:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-01359a17-7e2b-4b0a-8018-76005650c147" returned: 0 in 0.589s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:23:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Lock "cinder-quobyte-01359a17-7e2b-4b0a-8018-76005650c147" released by "delete_volume" :: held 2.017s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:23:54 devstack cinder-volume[86581]: DEBUG cinder.quota [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Created reservations ['7f439bed-0848-4d2a-9041-09ff5dbe5156', 'ea575e01-6749-4c25-a87f-1e6b11590dff', 'ad19fa22-059d-4c8a-9e17-7c25553c8b14', 'e1b7aa8b-594f-41c5-90af-627c48129dc9'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:23:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:23:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:23:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:23:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:23:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:23:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:23:54 devstack sudo[104334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:23:54 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:23:54 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root
Jun 06 01:23:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.648s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:23:54 devstack cinder-volume[86581]: DEBUG cinder.manager [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:23:54 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Deleted volume successfully.
Jun 06 01:23:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [req-dece5e02-a661-4256-a885-368148155e1f req-82165f1a-de22-422c-bba7-946d85beccff tempest-TestShelveInstance-1438614588 None] Lock "cinder-01359a17-7e2b-4b0a-8018-76005650c147-delete_volume" released by "delete_volume" :: held 2.862s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:23:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:23:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:23:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:23:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:23:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:23:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:23:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:23:59 devstack sudo[104339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:23:59 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:23:59 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root
Jun 06 01:23:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.622s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:23:59 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:24:04 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=4,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:24:04 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Flow 'volume_create_manager' (18600f4f-8d3e-4292-a4f4-fca7465b5932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d13ab2-5819-435e-9e23-0e935e7a4d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d13ab2-5819-435e-9e23-0e935e7a4d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1407841062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6e1eb7-199b-4a47-a51e-c3cbebe9d699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce1d15d51dc43ec84a4d092273db19d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:24:22Z,use_quota=True,user_id='1bfadffdca3b418384dc5f6d084a4f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17787155-ae5c-497c-8fbf-b95110c57707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17787155-ae5c-497c-8fbf-b95110c57707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a4964b-41f3-4b52-8645-bda559c6a8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a4964b-41f3-4b52-8645-bda559c6a8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e6e1eb7-199b-4a47-a51e-c3cbebe9d699', 'volume_name': 'volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2d16be-ae86-4e59-92e7-49578633face) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2d16be-ae86-4e59-92e7-49578633face) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f28dd7f-ddbb-4d14-8a86-b3abf2e2f53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:24:22 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Volume 6e6e1eb7-199b-4a47-a51e-c3cbebe9d699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699', 'volume_size': 1}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1407841062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6e1eb7-199b-4a47-a51e-c3cbebe9d699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce1d15d51dc43ec84a4d092273db19d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:24:22Z,use_quota=True,user_id='1bfadffdca3b418384dc5f6d084a4f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Creating volume 6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:24:22 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:24:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:24:22 devstack sudo[104388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 1073741824
Jun 06 01:24:22 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:24:23 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root
Jun 06 01:24:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 1073741824" returned: 0 in 0.880s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:24:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:24:23 devstack sudo[104399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699
Jun 06 01:24:23 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:24:24 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root
Jun 06 01:24:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699" returned: 0 in 0.614s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:24:24 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:24:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:24:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f28dd7f-ddbb-4d14-8a86-b3abf2e2f53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:24:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be136b14-4aaf-41eb-ac4b-88627dfdbe5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:24:24 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Volume volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 (6e6e1eb7-199b-4a47-a51e-c3cbebe9d699): created successfully
Jun 06 01:24:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be136b14-4aaf-41eb-ac4b-88627dfdbe5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:24:24 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Flow 'volume_create_manager' (18600f4f-8d3e-4292-a4f4-fca7465b5932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:24:24 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-547c1c34-f8f8-440f-b3d5-40344d6ff4d6 tempest-TestStampPattern-435843904 None] Created volume successfully.
Jun 06 01:24:34 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:24:34 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:24:49 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=1 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:24:49 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=1 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:25:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-2fdf779f-7931-41d8-a1ed-5885e4e9da75 req-7012110c-af62-46e5-8e08-d671193db94c tempest-TestStampPattern-435843904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:25:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-2fdf779f-7931-41d8-a1ed-5885e4e9da75 req-7012110c-af62-46e5-8e08-d671193db94c tempest-TestStampPattern-435843904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:25:02 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf172a38-ed3e-4ce1-b826-7558afbbb814]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:25:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-2fdf779f-7931-41d8-a1ed-5885e4e9da75 req-7012110c-af62-46e5-8e08-d671193db94c tempest-TestStampPattern-435843904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:25:02 devstack sudo[104543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699
Jun 06 01:25:02 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:25:03 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root
Jun 06 01:25:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-2fdf779f-7931-41d8-a1ed-5885e4e9da75 req-7012110c-af62-46e5-8e08-d671193db94c tempest-TestStampPattern-435843904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699" returned: 0 in 0.681s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:25:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-2fdf779f-7931-41d8-a1ed-5885e4e9da75 req-7012110c-af62-46e5-8e08-d671193db94c tempest-TestStampPattern-435843904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.699s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:25:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-2fdf779f-7931-41d8-a1ed-5885e4e9da75 req-7012110c-af62-46e5-8e08-d671193db94c tempest-TestStampPattern-435843904 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea0274a4-92e1-47d2-a9bc-b67988b3d509', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:25:03 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-2fdf779f-7931-41d8-a1ed-5885e4e9da75 req-7012110c-af62-46e5-8e08-d671193db94c tempest-TestStampPattern-435843904 None] attachment_update completed successfully.
Jun 06 01:25:11 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-449408e0-b2bb-4a9a-8a8c-d60ad61b061e req-9ccf5069-3b4e-4f07-bd9f-7d5818dddb7e tempest-TestStampPattern-435843904 None] Terminate volume connection completed successfully.
Jun 06 01:25:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-449408e0-b2bb-4a9a-8a8c-d60ad61b061e req-9ccf5069-3b4e-4f07-bd9f-7d5818dddb7e tempest-TestStampPattern-435843904 None] Deleting attachment ea0274a4-92e1-47d2-a9bc-b67988b3d509. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:25:13 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:25:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:25:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:25:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] Creating offline snapshot a4709c99-c1c7-499d-832f-202045f0b5b6 of volume 6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:25:13 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f790d5-ad7b-4c4c-a3b5-51c0cf2b782c]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:25:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:25:13 devstack sudo[105396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699
Jun 06 01:25:13 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:25:14 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root
Jun 06 01:25:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699" returned: 0 in 0.697s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:25:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:25:14 devstack sudo[105401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6 1G
Jun 06 01:25:14 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:25:15 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root
Jun 06 01:25:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6 1G" returned: 0 in 0.736s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:25:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:25:15 devstack sudo[105407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6
Jun 06 01:25:15 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:25:15 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root
Jun 06 01:25:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6" returned: 0 in 0.618s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:25:15 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6 is being set with open permissions: ugo+rw
Jun 06 01:25:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:25:15 devstack sudo[105412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6
Jun 06 01:25:15 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:25:16 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root
Jun 06 01:25:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6" returned: 0 in 0.589s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:25:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:25:16 devstack sudo[105415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.info
Jun 06 01:25:16 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:25:16 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root
Jun 06 01:25:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.info" returned: 0 in 0.597s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:25:16 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.info is being set with open permissions: ugo+rw
Jun 06 01:25:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:25:16 devstack sudo[105454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.info
Jun 06 01:25:16 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:25:17 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root
Jun 06 01:25:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.info" returned: 0 in 0.598s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:25:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.911s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:25:17 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-7d1ee8f0-c813-464c-90b6-d3a778129399 tempest-TestStampPattern-435843904 None] Create snapshot completed successfully
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Flow 'volume_create_manager' (a96a6915-f059-4f58-9854-7d787875c093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ffabc7-b97c-46fb-93a9-a2f7c4096051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ffabc7-b97c-46fb-93a9-a2f7c4096051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-819379200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48de0bb6-a939-4549-a140-b3860dff361b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce1d15d51dc43ec84a4d092273db19d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a4709c99-c1c7-499d-832f-202045f0b5b6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:25:27Z,use_quota=True,user_id='1bfadffdca3b418384dc5f6d084a4f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bb583d-c14c-46e4-91c2-59fa0c3bfb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bb583d-c14c-46e4-91c2-59fa0c3bfb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4efe60c6-4512-4de0-8aff-0624b61eb76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4efe60c6-4512-4de0-8aff-0624b61eb76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '48de0bb6-a939-4549-a140-b3860dff361b', 'volume_name': 'volume-48de0bb6-a939-4549-a140-b3860dff361b', 'volume_size': 1, 'snapshot_id': 'a4709c99-c1c7-499d-832f-202045f0b5b6'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da30f0b2-d17b-4554-88b1-fd22f1433516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da30f0b2-d17b-4554-88b1-fd22f1433516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea231364-d4e3-4beb-a45e-ad27fbcb7170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:25:27 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Volume 48de0bb6-a939-4549-a140-b3860dff361b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-48de0bb6-a939-4549-a140-b3860dff361b', 'volume_size': 1, 'snapshot_id': 'a4709c99-c1c7-499d-832f-202045f0b5b6'}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Acquiring lock "cinder-quobyte-a4709c99-c1c7-499d-832f-202045f0b5b6-48de0bb6-a939-4549-a140-b3860dff361b" by "_create_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Lock "cinder-quobyte-a4709c99-c1c7-499d-832f-202045f0b5b6-48de0bb6-a939-4549-a140-b3860dff361b" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Creating volume 48de0bb6-a939-4549-a140-b3860dff361b from snapshot a4709c99-c1c7-499d-832f-202045f0b5b6 {{(pid=86581) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Acquiring lock "cinder-quobyte-48de0bb6-a939-4549-a140-b3860dff361b" by "_copy_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Lock "cinder-quobyte-48de0bb6-a939-4549-a140-b3860dff361b" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] snapshot: a4709c99-c1c7-499d-832f-202045f0b5b6, volume: 48de0bb6-a939-4549-a140-b3860dff361b,  {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a58537-6c32-436d-9088-3b10eab37e92]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:25:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:25:27 devstack sudo[105499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6
Jun 06 01:25:27 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:25:28 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root
Jun 06 01:25:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6" returned: 0 in 0.750s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:25:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:25:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 06 01:25:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Creating direct copy from snapshot {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 06 01:25:28 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[e383e86e-8df8-4984-88b1-63b5a0ea6e92]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:25:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:25:28 devstack sudo[105507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699
Jun 06 01:25:28 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:25:28 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root
Jun 06 01:25:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699" returned: 0 in 0.728s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:25:28 devstack cinder-volume[86581]: DEBUG cinder.utils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Path /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b not found in is_blk_device check {{(pid=86581) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jun 06 01:25:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:25:29 devstack sudo[105512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b
Jun 06 01:25:29 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:25:33 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root
Jun 06 01:25:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b" returned: 0 in 4.729s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:25:33 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[3504de8e-6362-420b-8c98-f112aba8c39c]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:25:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:25:33 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699
Jun 06 01:25:33 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:25:34 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Jun 06 01:25:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699" returned: 0 in 1.002s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:25:34 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Image conversion details: src /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699, size 1024.00 MB, duration 4.73 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:25:34 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Converted 1024.00 MB image at 216.48 MB/s
Jun 06 01:25:34 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b is being set with open permissions: ugo+rw
Jun 06 01:25:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:25:34 devstack sudo[105532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b
Jun 06 01:25:34 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:25:35 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root
Jun 06 01:25:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b" returned: 0 in 0.705s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:25:35 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Lock "cinder-quobyte-48de0bb6-a939-4549-a140-b3860dff361b" released by "_copy_volume_from_snapshot" :: held 8.013s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:25:35 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Lock "cinder-quobyte-a4709c99-c1c7-499d-832f-202045f0b5b6-48de0bb6-a939-4549-a140-b3860dff361b" released by "_create_volume_from_snapshot" :: held 8.045s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:25:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.061s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:25:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea231364-d4e3-4beb-a45e-ad27fbcb7170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48de0bb6-a939-4549-a140-b3860dff361b', 'volume_size': 1, 'snapshot_id': 'a4709c99-c1c7-499d-832f-202045f0b5b6'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:25:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da00fb8f-48c7-4766-8a7e-0d33fa2ba082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:25:35 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Volume volume-48de0bb6-a939-4549-a140-b3860dff361b (48de0bb6-a939-4549-a140-b3860dff361b): created successfully
Jun 06 01:25:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da00fb8f-48c7-4766-8a7e-0d33fa2ba082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:25:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Flow 'volume_create_manager' (a96a6915-f059-4f58-9854-7d787875c093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:25:35 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-3b37575a-6454-48cd-ae89-453064fe5df4 tempest-TestStampPattern-435843904 None] Created volume successfully.
Jun 06 01:25:45 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:25:45 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=2 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:25:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:25:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:25:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:25:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:25:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:25:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:25:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:25:59 devstack sudo[105635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:25:59 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:25:59 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root
Jun 06 01:25:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.586s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:25:59 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:26:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-07e4404a-8d0f-4d32-bf79-27500c2f4492 req-7f548e0f-adf5-4cf4-a42f-53b82804e9fd tempest-TestStampPattern-435843904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:26:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-07e4404a-8d0f-4d32-bf79-27500c2f4492 req-7f548e0f-adf5-4cf4-a42f-53b82804e9fd tempest-TestStampPattern-435843904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:26:10 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[152b9762-57ef-4355-9323-74cd591ca54b]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:26:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-07e4404a-8d0f-4d32-bf79-27500c2f4492 req-7f548e0f-adf5-4cf4-a42f-53b82804e9fd tempest-TestStampPattern-435843904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:10 devstack sudo[105654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b
Jun 06 01:26:10 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:11 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [req-07e4404a-8d0f-4d32-bf79-27500c2f4492 req-7f548e0f-adf5-4cf4-a42f-53b82804e9fd tempest-TestStampPattern-435843904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b" returned: 0 in 0.706s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [req-07e4404a-8d0f-4d32-bf79-27500c2f4492 req-7f548e0f-adf5-4cf4-a42f-53b82804e9fd tempest-TestStampPattern-435843904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.723s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:26:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-07e4404a-8d0f-4d32-bf79-27500c2f4492 req-7f548e0f-adf5-4cf4-a42f-53b82804e9fd tempest-TestStampPattern-435843904 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee', 'name': 'volume-48de0bb6-a939-4549-a140-b3860dff361b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '628d59b4-b559-4244-9266-d13494d879b1', 'enforce_multipath': True} {{(pid=86581) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 06 01:26:11 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-07e4404a-8d0f-4d32-bf79-27500c2f4492 req-7f548e0f-adf5-4cf4-a42f-53b82804e9fd tempest-TestStampPattern-435843904 None] attachment_update completed successfully.
Jun 06 01:26:17 devstack cinder-volume[86581]: INFO cinder.volume.manager [req-371d5484-9bb6-4bde-859a-8b63528f6f55 req-cdf9b074-744a-4f70-ba69-60f8a2eb766d tempest-TestStampPattern-435843904 None] Terminate volume connection completed successfully.
Jun 06 01:26:17 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [req-371d5484-9bb6-4bde-859a-8b63528f6f55 req-cdf9b074-744a-4f70-ba69-60f8a2eb766d tempest-TestStampPattern-435843904 None] Deleting attachment 628d59b4-b559-4244-9266-d13494d879b1. {{(pid=86581) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 06 01:26:21 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:26:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] Acquiring lock "cinder-48de0bb6-a939-4549-a140-b3860dff361b-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:26:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] Lock "cinder-48de0bb6-a939-4549-a140-b3860dff361b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:26:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] Acquiring lock "cinder-quobyte-48de0bb6-a939-4549-a140-b3860dff361b" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:26:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] Lock "cinder-quobyte-48de0bb6-a939-4549-a140-b3860dff361b" acquired by "delete_volume" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:26:26 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fefe6c-4cab-4411-87de-c868fc45598b]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:26:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:26 devstack sudo[106168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b
Jun 06 01:26:26 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:27 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b" returned: 0 in 0.689s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:27 devstack sudo[106173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b
Jun 06 01:26:27 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:28 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-48de0bb6-a939-4549-a140-b3860dff361b" returned: 0 in 0.603s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:28 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] Lock "cinder-quobyte-48de0bb6-a939-4549-a140-b3860dff361b" released by "delete_volume" :: held 1.330s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:26:28 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] Created reservations ['439471df-8f87-466a-9696-4a3f9e8cdb61', '6d05cf43-894d-4e28-b884-35061c786e24', '8ebbf6d2-d878-481f-975e-00072716da6e', '5a26322e-5202-40d6-a3ef-db20c127fbf8'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:26:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:26:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:26:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:26:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:26:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:26:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:28 devstack sudo[106176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:26:28 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:28 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.589s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:28 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:26:28 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] Deleted volume successfully.
Jun 06 01:26:28 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-94f722a0-f453-4982-9b7d-a6ba4be139fb tempest-TestStampPattern-435843904 None] Lock "cinder-48de0bb6-a939-4549-a140-b3860dff361b-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:26:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] Acquiring lock "cinder-a4709c99-c1c7-499d-832f-202045f0b5b6-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:26:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] Lock "cinder-a4709c99-c1c7-499d-832f-202045f0b5b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:26:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] Acquiring lock "cinder-quobyte-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:26:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] Lock "cinder-quobyte-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:26:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] Acquiring lock "cinder-quobyte-a4709c99-c1c7-499d-832f-202045f0b5b6" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:26:29 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] Lock "cinder-quobyte-a4709c99-c1c7-499d-832f-202045f0b5b6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:26:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] Deleting offline snapshot a4709c99-c1c7-499d-832f-202045f0b5b6 of volume 6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:26:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] snapshot_file for this snap is: volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:26:29 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade5b719-74f2-4cdc-baf8-70457cdb9b45]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:26:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:29 devstack sudo[106179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6
Jun 06 01:26:29 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:29 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6" returned: 0 in 0.696s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:26:29 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[130ab1bf-eaf7-478a-95d1-f025a4a030e3]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:26:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:29 devstack sudo[106184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699
Jun 06 01:26:29 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:30 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699" returned: 0 in 0.683s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:30 devstack sudo[106189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6
Jun 06 01:26:30 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:31 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6" returned: 0 in 0.677s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:31 devstack sudo[106194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6
Jun 06 01:26:31 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:31 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699.a4709c99-c1c7-499d-832f-202045f0b5b6" returned: 0 in 0.598s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:31 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] Lock "cinder-quobyte-a4709c99-c1c7-499d-832f-202045f0b5b6" released by "_delete_snapshot" :: held 2.741s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:26:31 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] Lock "cinder-quobyte-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699" released by "delete_snapshot" :: held 2.760s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:26:31 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] Created reservations ['e11c5b7e-0d63-4ae4-baf0-e9e25897580f', '2e614165-0714-41eb-850d-aa9e04b68519', '72ad37c8-13cd-499c-92cd-78cc7e6aaccd', 'd273bc03-b985-49d1-abed-d3579565e23b'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:26:31 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] Delete snapshot completed successfully.
Jun 06 01:26:31 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7d80bad6-949f-40e4-b1a1-f2401b92f82b tempest-TestStampPattern-435843904 None] Lock "cinder-a4709c99-c1c7-499d-832f-202045f0b5b6-delete_snapshot" released by "delete_snapshot" :: held 2.901s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:26:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] Acquiring lock "cinder-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:26:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] Lock "cinder-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:26:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] Acquiring lock "cinder-quobyte-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:26:39 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] Lock "cinder-quobyte-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699" acquired by "delete_volume" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:26:39 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d82b57-fe85-4ef4-bf8e-8d751d7142c3]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:26:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:39 devstack sudo[106296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699
Jun 06 01:26:39 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:39 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699" returned: 0 in 0.694s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:40 devstack sudo[106301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699
Jun 06 01:26:40 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:40 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699" returned: 0 in 0.595s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:40 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] Lock "cinder-quobyte-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699" released by "delete_volume" :: held 1.343s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:26:40 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] Created reservations ['c588f256-39fe-4621-b4d0-8c806268ab56', '44978569-5d4b-46a7-8c27-0f81961bfa08', 'de00b956-da26-4efd-ae33-9c7f38b2042d', '2a03f043-70b5-4670-b940-2b0928bf3a17'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:26:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:26:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:26:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:26:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:26:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:26:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:40 devstack sudo[106304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:26:40 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:41 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.596s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:41 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:26:41 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] Deleted volume successfully.
Jun 06 01:26:41 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-81f646d3-ed50-48a2-be8e-57955103a1ca tempest-TestStampPattern-435843904 None] Lock "cinder-6e6e1eb7-199b-4a47-a51e-c3cbebe9d699-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:26:50 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=25,cinder:UPDATE=23,cinder:INSERT=4 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:26:51 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=22,cinder:SELECT=14,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:26:53 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:26:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Flow 'volume_create_manager' (f6fd2b1f-d475-4a15-befb-037b2b042420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:26:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab9ac7f-68d5-4a83-8fa7-a7d967faab8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:26:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab9ac7f-68d5-4a83-8fa7-a7d967faab8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793afc94-2e77-4f18-9c4c-9d06ae9561c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7268725bac3e4c73b7002a5fb5f99076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:26:53Z,use_quota=True,user_id='a50b46f5e2044721830c6b5362a76231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72b22394-022e-4d73-8fcb-c0d8e9044175),volume_type_id=72b22394-022e-4d73-8fcb-c0d8e9044175)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:26:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485ee952-134a-4c42-93ff-530d464f1af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:26:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485ee952-134a-4c42-93ff-530d464f1af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:26:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd6c008-72d8-498e-b66a-e18880171f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:26:53 devstack cinder-volume[86581]: DEBUG cinder.image.glance [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Creating Keystone auth plugin from conf {{(pid=86581) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 06 01:26:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd6c008-72d8-498e-b66a-e18880171f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '793afc94-2e77-4f18-9c4c-9d06ae9561c0', 'volume_name': 'volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0', 'volume_size': 1, 'image_id': '45fcf56e-4c5e-4877-a769-cfb355a48ea1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45fcf56e-4c5e-4877-a769-cfb355a48ea1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '24bf5108f6ec4bd93a43d11888285f54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7268725bac3e4c73b7002a5fb5f99076', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e5b9c4c6a569766f46c9479b3797c7829ef2dfb5510523d4a964dc1c5309b137c0dbfabb6a2ed9eec22d593ca97a1b6c6f01fcb67a80fdd3862a933a15bb2e5', 'id': '45fcf56e-4c5e-4877-a769-cfb355a48ea1', 'created_at': datetime.datetime(2026, 6, 5, 23, 26, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 23, 26, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45fcf56e-4c5e-4877-a769-cfb355a48ea1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2eca210>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:26:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfacb2f9-1b0e-4e5b-93f9-0ef63d2dbd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:26:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfacb2f9-1b0e-4e5b-93f9-0ef63d2dbd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:26:53 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3978bf75-c809-48bf-8b2d-2e0dbfb92d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:26:53 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Volume 793afc94-2e77-4f18-9c4c-9d06ae9561c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0', 'volume_size': 1, 'image_id': '45fcf56e-4c5e-4877-a769-cfb355a48ea1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45fcf56e-4c5e-4877-a769-cfb355a48ea1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '24bf5108f6ec4bd93a43d11888285f54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7268725bac3e4c73b7002a5fb5f99076', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e5b9c4c6a569766f46c9479b3797c7829ef2dfb5510523d4a964dc1c5309b137c0dbfabb6a2ed9eec22d593ca97a1b6c6f01fcb67a80fdd3862a933a15bb2e5', 'id': '45fcf56e-4c5e-4877-a769-cfb355a48ea1', 'created_at': datetime.datetime(2026, 6, 5, 23, 26, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 23, 26, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45fcf56e-4c5e-4877-a769-cfb355a48ea1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2eca210>}
Jun 06 01:26:53 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Trying to clone 793afc94-2e77-4f18-9c4c-9d06ae9561c0 from image 45fcf56e-4c5e-4877-a769-cfb355a48ea1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/45fcf56e-4c5e-4877-a769-cfb355a48ea1', 'metadata': {}}]). {{(pid=86581) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Jun 06 01:26:53 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jun 06 01:26:53 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Image download 0.00 MB at 0.00 MB/s
Jun 06 01:26:53 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6ebfb8-98fb-491c-a2d8-cfa607447187]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:26:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:53 devstack sudo[106313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD
Jun 06 01:26:53 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:54 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD" returned: 0 in 0.678s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:54 devstack sudo[106317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD
Jun 06 01:26:54 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:55 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD" returned: 1 in 0.670s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:26:55 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Temporary image 45fcf56e-4c5e-4877-a769-cfb355a48ea1 is fetched for user a50b46f5e2044721830c6b5362a76231. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jun 06 01:26:55 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[9536c2c8-30d8-49a1-b6c0-3a39ea7dcb9b]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:26:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:55 devstack sudo[106322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD
Jun 06 01:26:55 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:55 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD" returned: 0 in 0.664s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:55 devstack sudo[106326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD
Jun 06 01:26:55 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:56 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD" returned: 1 in 0.657s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:26:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:26:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:26:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793afc94-2e77-4f18-9c4c-9d06ae9561c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7268725bac3e4c73b7002a5fb5f99076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:26:53Z,use_quota=True,user_id='a50b46f5e2044721830c6b5362a76231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72b22394-022e-4d73-8fcb-c0d8e9044175),volume_type_id=72b22394-022e-4d73-8fcb-c0d8e9044175)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:26:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Creating volume 793afc94-2e77-4f18-9c4c-9d06ae9561c0 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:26:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:26:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:26:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:26:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:26:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:26:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:26:56 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:26:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:56 devstack sudo[106331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0 1073741824
Jun 06 01:26:56 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:57 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0 1073741824" returned: 0 in 0.754s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:57 devstack sudo[106339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0
Jun 06 01:26:57 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:57 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0" returned: 0 in 0.605s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:26:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:26:57 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Attempting download of 45fcf56e-4c5e-4877-a769-cfb355a48ea1 ((None, [{'url': 'file:///opt/stack/data/glance/images/45fcf56e-4c5e-4877-a769-cfb355a48ea1', 'metadata': {}}])) to volume 793afc94-2e77-4f18-9c4c-9d06ae9561c0. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jun 06 01:26:58 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac704661-1d5b-4d51-b29b-e8e8726ea9d4]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:26:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45fcf56e-4c5e-4877-a769-cfb355a48ea1_uvobz3v_ {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:58 devstack sudo[106342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45fcf56e-4c5e-4877-a769-cfb355a48ea1_uvobz3v_
Jun 06 01:26:58 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:58 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45fcf56e-4c5e-4877-a769-cfb355a48ea1_uvobz3v_" returned: 0 in 0.671s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45fcf56e-4c5e-4877-a769-cfb355a48ea1_uvobz3v_ {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:58 devstack sudo[106346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45fcf56e-4c5e-4877-a769-cfb355a48ea1_uvobz3v_
Jun 06 01:26:58 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:59 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:26:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:26:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:26:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:26:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:26:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:26:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45fcf56e-4c5e-4877-a769-cfb355a48ea1_uvobz3v_" returned: 1 in 0.676s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45fcf56e-4c5e-4877-a769-cfb355a48ea1_uvobz3v_' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:26:59 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc66c269-98e6-47a2-bfaf-0ca620e594a9]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:26:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:26:59 devstack sudo[106350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:26:59 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:59 devstack sudo[106351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD
Jun 06 01:26:59 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:26:59 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root
Jun 06 01:26:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.585s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:26:59 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:27:00 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD" returned: 0 in 0.665s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:00 devstack sudo[106357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD
Jun 06 01:27:00 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:00 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD" returned: 1 in 0.650s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:27:00 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] 45fcf56e-4c5e-4877-a769-cfb355a48ea1 was raw, converting to raw {{(pid=86581) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jun 06 01:27:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:00 devstack sudo[106362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0
Jun 06 01:27:00 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:01 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0" returned: 0 in 0.661s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:01 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_45fcf56e-4c5e-4877-a769-cfb355a48ea1_ryjq9prkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0 {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:27:01 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Converted 0.00 MB image at 0.00 MB/s
Jun 06 01:27:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:01 devstack sudo[106367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0 1G
Jun 06 01:27:01 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:01 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0 1G" returned: 0 in 0.614s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:02 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef48965-a262-4a6e-80fc-ee2ddbc92ea4]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:27:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:02 devstack sudo[106372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0
Jun 06 01:27:02 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:02 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0" returned: 0 in 0.673s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:02 devstack sudo[106376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0
Jun 06 01:27:02 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:03 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0" returned: 1 in 0.680s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:27:03 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Downloaded image 45fcf56e-4c5e-4877-a769-cfb355a48ea1 ((None, [{'url': 'file:///opt/stack/data/glance/images/45fcf56e-4c5e-4877-a769-cfb355a48ea1', 'metadata': {}}])) to volume 793afc94-2e77-4f18-9c4c-9d06ae9561c0 successfully. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jun 06 01:27:03 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Temporary image 45fcf56e-4c5e-4877-a769-cfb355a48ea1 for user a50b46f5e2044721830c6b5362a76231 is deleted. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jun 06 01:27:03 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Marking volume 793afc94-2e77-4f18-9c4c-9d06ae9561c0 as bootable. {{(pid=86581) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jun 06 01:27:03 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Copying metadata from image 45fcf56e-4c5e-4877-a769-cfb355a48ea1 to 793afc94-2e77-4f18-9c4c-9d06ae9561c0. {{(pid=86581) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 06 01:27:03 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Creating volume glance metadata for volume 793afc94-2e77-4f18-9c4c-9d06ae9561c0 backed by image 45fcf56e-4c5e-4877-a769-cfb355a48ea1 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '45fcf56e-4c5e-4877-a769-cfb355a48ea1', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '24bf5108f6ec4bd93a43d11888285f54', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86581) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 06 01:27:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3978bf75-c809-48bf-8b2d-2e0dbfb92d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0', 'volume_size': 1, 'image_id': '45fcf56e-4c5e-4877-a769-cfb355a48ea1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45fcf56e-4c5e-4877-a769-cfb355a48ea1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '24bf5108f6ec4bd93a43d11888285f54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7268725bac3e4c73b7002a5fb5f99076', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e5b9c4c6a569766f46c9479b3797c7829ef2dfb5510523d4a964dc1c5309b137c0dbfabb6a2ed9eec22d593ca97a1b6c6f01fcb67a80fdd3862a933a15bb2e5', 'id': '45fcf56e-4c5e-4877-a769-cfb355a48ea1', 'created_at': datetime.datetime(2026, 6, 5, 23, 26, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 23, 26, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45fcf56e-4c5e-4877-a769-cfb355a48ea1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2eca210>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16957744-1cf6-45da-a01d-092cbb9fcc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:03 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Volume volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0 (793afc94-2e77-4f18-9c4c-9d06ae9561c0): created successfully
Jun 06 01:27:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16957744-1cf6-45da-a01d-092cbb9fcc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Flow 'volume_create_manager' (f6fd2b1f-d475-4a15-befb-037b2b042420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:03 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-18d766a7-aafc-44a5-943d-33d50af80373 tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Created volume successfully.
Jun 06 01:27:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Acquiring lock "cinder-793afc94-2e77-4f18-9c4c-9d06ae9561c0-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Lock "cinder-793afc94-2e77-4f18-9c4c-9d06ae9561c0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Acquiring lock "cinder-quobyte-793afc94-2e77-4f18-9c4c-9d06ae9561c0" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Lock "cinder-quobyte-793afc94-2e77-4f18-9c4c-9d06ae9561c0" acquired by "delete_volume" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:04 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[087ea52e-4901-4c55-af79-7e457459f293]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:27:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:04 devstack sudo[106382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0
Jun 06 01:27:04 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:04 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0" returned: 0 in 0.695s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:04 devstack sudo[106386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0
Jun 06 01:27:04 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:05 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0" returned: 1 in 0.674s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:27:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:05 devstack sudo[106391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0
Jun 06 01:27:05 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:06 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-793afc94-2e77-4f18-9c4c-9d06ae9561c0" returned: 0 in 0.573s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Lock "cinder-quobyte-793afc94-2e77-4f18-9c4c-9d06ae9561c0" released by "delete_volume" :: held 1.998s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:06 devstack cinder-volume[86581]: WARNING cinder.quota [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:27:06 devstack cinder-volume[86581]: WARNING cinder.quota [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 06 01:27:06 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Created reservations ['fc6c48b3-f126-4995-8ab3-79789003e54c', 'e5afd362-4767-481a-aa6b-75742791e079', '0c1b2043-29cd-483d-81cd-9559e5c1d321', '0ae712e2-8c7f-4abb-b239-e5f608aa5559'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:27:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:06 devstack sudo[106394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:27:06 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:06 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.587s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:06 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:27:06 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Deleted volume successfully.
Jun 06 01:27:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-21e0e04c-b759-4f9e-a9fd-7821210e511e tempest-VolumeAndVolumeTypeFromImageTest-908083237 None] Lock "cinder-793afc94-2e77-4f18-9c4c-9d06ae9561c0-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Flow 'volume_create_manager' (c04959d4-f0c7-4a52-b880-cb459c9cf8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401ac2b1-dbce-403b-87a7-5e8bbb3bc131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401ac2b1-dbce-403b-87a7-5e8bbb3bc131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-31405776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f992af06-5f43-4d63-a711-c95f11817b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705a3ad1fcfb476ca690907ebde5725b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:10Z,use_quota=True,user_id='ba6a203d2ce04e2eabffcb63186c0a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd578d66-eed2-42a0-94a7-0a7272911d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd578d66-eed2-42a0-94a7-0a7272911d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd5007d-f5e7-401c-9fc3-d6868abf4492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd5007d-f5e7-401c-9fc3-d6868abf4492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f992af06-5f43-4d63-a711-c95f11817b4d', 'volume_name': 'volume-f992af06-5f43-4d63-a711-c95f11817b4d', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8559e339-d522-42da-86ca-3e5cdf9a611f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8559e339-d522-42da-86ca-3e5cdf9a611f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7cef4f-634c-4cc4-aa92-10d1b17f5090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:10 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Volume f992af06-5f43-4d63-a711-c95f11817b4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f992af06-5f43-4d63-a711-c95f11817b4d', 'volume_size': 1}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-31405776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f992af06-5f43-4d63-a711-c95f11817b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705a3ad1fcfb476ca690907ebde5725b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:10Z,use_quota=True,user_id='ba6a203d2ce04e2eabffcb63186c0a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Creating volume f992af06-5f43-4d63-a711-c95f11817b4d {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:27:10 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f992af06-5f43-4d63-a711-c95f11817b4d 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:10 devstack sudo[106397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f992af06-5f43-4d63-a711-c95f11817b4d 1073741824
Jun 06 01:27:10 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Flow 'volume_create_manager' (e2a4caaf-56db-423a-8a94-df49507c9c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e9d284-52e0-4d56-a0b0-b65a7c1cc847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e9d284-52e0-4d56-a0b0-b65a7c1cc847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1067962669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318b99c4-ca1e-4e07-aca3-4cad261cca4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705a3ad1fcfb476ca690907ebde5725b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:10Z,use_quota=True,user_id='ba6a203d2ce04e2eabffcb63186c0a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4563f4a-841e-48e9-a4a7-2daab9e9f4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4563f4a-841e-48e9-a4a7-2daab9e9f4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7b05e0-d849-4d47-a585-433af2224029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7b05e0-d849-4d47-a585-433af2224029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '318b99c4-ca1e-4e07-aca3-4cad261cca4d', 'volume_name': 'volume-318b99c4-ca1e-4e07-aca3-4cad261cca4d', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1962bc0-3227-444b-92b1-de0f420eaf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1962bc0-3227-444b-92b1-de0f420eaf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa147d0-66c0-4cab-a97a-d7d773bd7915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:10 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Volume 318b99c4-ca1e-4e07-aca3-4cad261cca4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-318b99c4-ca1e-4e07-aca3-4cad261cca4d', 'volume_size': 1}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Flow 'volume_create_manager' (274414ce-f605-4a4c-a06f-0e535f82ccc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260741ee-3bba-42f1-9f65-86a560173c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260741ee-3bba-42f1-9f65-86a560173c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2025386149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ac8f6d-4e72-4a79-9f30-3e41b0064231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705a3ad1fcfb476ca690907ebde5725b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:11Z,use_quota=True,user_id='ba6a203d2ce04e2eabffcb63186c0a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a902e656-b879-4e4f-b715-c87ee839b635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a902e656-b879-4e4f-b715-c87ee839b635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60a94e1-d726-4fc1-a1c8-bfc214f9b9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60a94e1-d726-4fc1-a1c8-bfc214f9b9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68ac8f6d-4e72-4a79-9f30-3e41b0064231', 'volume_name': 'volume-68ac8f6d-4e72-4a79-9f30-3e41b0064231', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3525af24-688e-44cb-9392-a4d26b4d7fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3525af24-688e-44cb-9392-a4d26b4d7fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8998f22a-6478-4cea-85bb-30e018a8d944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:10 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Volume 68ac8f6d-4e72-4a79-9f30-3e41b0064231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68ac8f6d-4e72-4a79-9f30-3e41b0064231', 'volume_size': 1}
Jun 06 01:27:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Flow 'volume_create_manager' (000a5295-376e-4dc6-bfb2-cb5a316082af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e8125d-3b30-435b-8c54-fe83807fdf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e8125d-3b30-435b-8c54-fe83807fdf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-647146016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0478bd3f-62e6-49d5-b087-484445586a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705a3ad1fcfb476ca690907ebde5725b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:11Z,use_quota=True,user_id='ba6a203d2ce04e2eabffcb63186c0a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f98382-6044-45c9-9a1e-6c0df3f36aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f98382-6044-45c9-9a1e-6c0df3f36aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73744a33-646e-4bec-8ac5-0cce86b02989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73744a33-646e-4bec-8ac5-0cce86b02989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0478bd3f-62e6-49d5-b087-484445586a3c', 'volume_name': 'volume-0478bd3f-62e6-49d5-b087-484445586a3c', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5769ba1a-e2d2-4722-8c7a-6c87996a7769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5769ba1a-e2d2-4722-8c7a-6c87996a7769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ee8bbe-7823-4f97-b54c-d5ee4c9c92c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:11 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Volume 0478bd3f-62e6-49d5-b087-484445586a3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0478bd3f-62e6-49d5-b087-484445586a3c', 'volume_size': 1}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:11 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f992af06-5f43-4d63-a711-c95f11817b4d 1073741824" returned: 0 in 0.915s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f992af06-5f43-4d63-a711-c95f11817b4d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:11 devstack sudo[106403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f992af06-5f43-4d63-a711-c95f11817b4d
Jun 06 01:27:11 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Flow 'volume_create_manager' (924185cf-d057-4a1b-a286-152c292ede86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525d0507-60e2-4cc5-9275-fa1e308f39e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525d0507-60e2-4cc5-9275-fa1e308f39e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-376245798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705a3ad1fcfb476ca690907ebde5725b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:11Z,use_quota=True,user_id='ba6a203d2ce04e2eabffcb63186c0a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35519b0e-5538-4e72-af1a-c48b5599de96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35519b0e-5538-4e72-af1a-c48b5599de96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42041805-b567-4238-98cc-aa8c13dcc4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42041805-b567-4238-98cc-aa8c13dcc4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c', 'volume_name': 'volume-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acac6622-e6af-4f43-8df5-f30f4c59aebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acac6622-e6af-4f43-8df5-f30f4c59aebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924df0af-eddd-41f3-8373-6e1bd3205f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:11 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Volume f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c', 'volume_size': 1}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:11 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f992af06-5f43-4d63-a711-c95f11817b4d" returned: 0 in 0.604s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.384s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1067962669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318b99c4-ca1e-4e07-aca3-4cad261cca4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705a3ad1fcfb476ca690907ebde5725b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:10Z,use_quota=True,user_id='ba6a203d2ce04e2eabffcb63186c0a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Creating volume 318b99c4-ca1e-4e07-aca3-4cad261cca4d {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:27:11 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-318b99c4-ca1e-4e07-aca3-4cad261cca4d 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7cef4f-634c-4cc4-aa92-10d1b17f5090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f992af06-5f43-4d63-a711-c95f11817b4d', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:11 devstack sudo[106406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-318b99c4-ca1e-4e07-aca3-4cad261cca4d 1073741824
Jun 06 01:27:11 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42ba182-e844-4bcc-88c6-b048741204a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:11 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Volume volume-f992af06-5f43-4d63-a711-c95f11817b4d (f992af06-5f43-4d63-a711-c95f11817b4d): created successfully
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42ba182-e844-4bcc-88c6-b048741204a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:11 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Flow 'volume_create_manager' (c04959d4-f0c7-4a52-b880-cb459c9cf8ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:11 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-a27ace5e-f738-4bbe-b0eb-301d006e25d3 tempest-CreateVolumesFromImageTest-621045993 None] Created volume successfully.
Jun 06 01:27:12 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-318b99c4-ca1e-4e07-aca3-4cad261cca4d 1073741824" returned: 0 in 0.776s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-318b99c4-ca1e-4e07-aca3-4cad261cca4d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:12 devstack sudo[106411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-318b99c4-ca1e-4e07-aca3-4cad261cca4d
Jun 06 01:27:12 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:13 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-318b99c4-ca1e-4e07-aca3-4cad261cca4d" returned: 0 in 0.586s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.468s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2025386149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ac8f6d-4e72-4a79-9f30-3e41b0064231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705a3ad1fcfb476ca690907ebde5725b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:11Z,use_quota=True,user_id='ba6a203d2ce04e2eabffcb63186c0a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Creating volume 68ac8f6d-4e72-4a79-9f30-3e41b0064231 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:27:13 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-68ac8f6d-4e72-4a79-9f30-3e41b0064231 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa147d0-66c0-4cab-a97a-d7d773bd7915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-318b99c4-ca1e-4e07-aca3-4cad261cca4d', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554556fc-b69e-47f8-8dae-23ba890434d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:13 devstack sudo[106414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-68ac8f6d-4e72-4a79-9f30-3e41b0064231 1073741824
Jun 06 01:27:13 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:13 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Volume volume-318b99c4-ca1e-4e07-aca3-4cad261cca4d (318b99c4-ca1e-4e07-aca3-4cad261cca4d): created successfully
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554556fc-b69e-47f8-8dae-23ba890434d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Flow 'volume_create_manager' (e2a4caaf-56db-423a-8a94-df49507c9c3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:13 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-8f1793ab-fb4d-45b5-a725-923e7705de26 tempest-CreateVolumesFromImageTest-621045993 None] Created volume successfully.
Jun 06 01:27:13 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-68ac8f6d-4e72-4a79-9f30-3e41b0064231 1073741824" returned: 0 in 0.731s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-68ac8f6d-4e72-4a79-9f30-3e41b0064231 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:14 devstack sudo[106420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-68ac8f6d-4e72-4a79-9f30-3e41b0064231
Jun 06 01:27:14 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:14 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-68ac8f6d-4e72-4a79-9f30-3e41b0064231" returned: 0 in 0.579s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:14 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:27:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.474s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:14 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-647146016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0478bd3f-62e6-49d5-b087-484445586a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705a3ad1fcfb476ca690907ebde5725b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:11Z,use_quota=True,user_id='ba6a203d2ce04e2eabffcb63186c0a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:27:14 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Creating volume 0478bd3f-62e6-49d5-b087-484445586a3c {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:27:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:14 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:14 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:14 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:27:14 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:27:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0478bd3f-62e6-49d5-b087-484445586a3c 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:14 devstack sudo[106423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0478bd3f-62e6-49d5-b087-484445586a3c 1073741824
Jun 06 01:27:14 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:14 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8998f22a-6478-4cea-85bb-30e018a8d944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68ac8f6d-4e72-4a79-9f30-3e41b0064231', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:14 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458773ee-61a7-4220-bda3-bf4dfb5adbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:14 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Volume volume-68ac8f6d-4e72-4a79-9f30-3e41b0064231 (68ac8f6d-4e72-4a79-9f30-3e41b0064231): created successfully
Jun 06 01:27:14 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458773ee-61a7-4220-bda3-bf4dfb5adbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:14 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Flow 'volume_create_manager' (274414ce-f605-4a4c-a06f-0e535f82ccc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:14 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-e660cfb7-f2b0-4bec-8049-3297e31d9a52 tempest-CreateVolumesFromImageTest-621045993 None] Created volume successfully.
Jun 06 01:27:15 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0478bd3f-62e6-49d5-b087-484445586a3c 1073741824" returned: 0 in 0.752s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0478bd3f-62e6-49d5-b087-484445586a3c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:15 devstack sudo[106429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0478bd3f-62e6-49d5-b087-484445586a3c
Jun 06 01:27:15 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:15 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0478bd3f-62e6-49d5-b087-484445586a3c" returned: 0 in 0.579s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:27:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.527s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-376245798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705a3ad1fcfb476ca690907ebde5725b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:11Z,use_quota=True,user_id='ba6a203d2ce04e2eabffcb63186c0a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:27:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Creating volume f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:27:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:27:15 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:27:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:15 devstack sudo[106432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c 1073741824
Jun 06 01:27:15 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ee8bbe-7823-4f97-b54c-d5ee4c9c92c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0478bd3f-62e6-49d5-b087-484445586a3c', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3589afdb-56cb-45ff-87c8-8b16c9613773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:16 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Volume volume-0478bd3f-62e6-49d5-b087-484445586a3c (0478bd3f-62e6-49d5-b087-484445586a3c): created successfully
Jun 06 01:27:16 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3589afdb-56cb-45ff-87c8-8b16c9613773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:16 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Flow 'volume_create_manager' (000a5295-376e-4dc6-bfb2-cb5a316082af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:16 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-1b3730fd-9202-4276-9bf4-4e0e6fdfe3ad tempest-CreateVolumesFromImageTest-621045993 None] Created volume successfully.
Jun 06 01:27:16 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c 1073741824" returned: 0 in 0.744s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:16 devstack sudo[106438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c
Jun 06 01:27:16 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:17 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c" returned: 0 in 0.586s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:27:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:17 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924df0af-eddd-41f3-8373-6e1bd3205f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:17 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbea867d-70dd-437a-bc5a-37241767fa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:17 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Volume volume-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c (f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c): created successfully
Jun 06 01:27:17 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbea867d-70dd-437a-bc5a-37241767fa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:17 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Flow 'volume_create_manager' (924185cf-d057-4a1b-a286-152c292ede86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:17 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-efe95a4f-2fcc-49ba-ac86-018fb627405f tempest-CreateVolumesFromImageTest-621045993 None] Created volume successfully.
Jun 06 01:27:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "cinder-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "cinder-quobyte-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:17 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-quobyte-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c" acquired by "delete_volume" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:18 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[772ca24e-12c9-4a46-acf6-197f60fb435f]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:27:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:18 devstack sudo[106483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c
Jun 06 01:27:18 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:18 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c" returned: 0 in 0.698s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:18 devstack sudo[106488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c
Jun 06 01:27:18 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:19 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c" returned: 0 in 0.569s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-quobyte-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c" released by "delete_volume" :: held 1.304s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:19 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] Created reservations ['550ed3fc-4d64-44f4-8958-03b1a2269b62', '02aa64a0-5710-4342-96de-ffa3c5ef26e2', '2c5498e9-d65e-45dc-991e-c49296458428', '3539a93e-6a69-424c-8f6f-5cbcfdbf5825'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:27:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:19 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:19 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:19 devstack sudo[106491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:27:19 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:19 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.573s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:19 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:27:19 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] Deleted volume successfully.
Jun 06 01:27:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2da3b97-8aae-4903-8ce6-4565b2d25ea7 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-f7ce1ea8-a864-4ea3-b4b6-d0af585cb45c-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "cinder-0478bd3f-62e6-49d5-b087-484445586a3c-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-0478bd3f-62e6-49d5-b087-484445586a3c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "cinder-quobyte-0478bd3f-62e6-49d5-b087-484445586a3c" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-quobyte-0478bd3f-62e6-49d5-b087-484445586a3c" acquired by "delete_volume" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:20 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ce1cee-9c94-4642-8311-c4f7ec84e3c7]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:27:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0478bd3f-62e6-49d5-b087-484445586a3c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:20 devstack sudo[106494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0478bd3f-62e6-49d5-b087-484445586a3c
Jun 06 01:27:20 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:20 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0478bd3f-62e6-49d5-b087-484445586a3c" returned: 0 in 0.706s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0478bd3f-62e6-49d5-b087-484445586a3c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:20 devstack sudo[106499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0478bd3f-62e6-49d5-b087-484445586a3c
Jun 06 01:27:20 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:21 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0478bd3f-62e6-49d5-b087-484445586a3c" returned: 0 in 0.580s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-quobyte-0478bd3f-62e6-49d5-b087-484445586a3c" released by "delete_volume" :: held 1.324s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:21 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] Created reservations ['81c78499-db32-45eb-90e2-d97d636f86d9', '1d81f938-fb49-4ff1-a19f-702283cc03b1', '82d2c528-0c69-4a9f-bf38-9d139919fec3', '543203fe-9e70-4fbf-9b00-7440086d0180'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:27:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:21 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:21 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:21 devstack sudo[106502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:27:21 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:22 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.595s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:22 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:27:22 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] Deleted volume successfully.
Jun 06 01:27:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9f03bf1f-540d-46c7-8f02-09395768c6b4 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-0478bd3f-62e6-49d5-b087-484445586a3c-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "cinder-68ac8f6d-4e72-4a79-9f30-3e41b0064231-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-68ac8f6d-4e72-4a79-9f30-3e41b0064231-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "cinder-quobyte-68ac8f6d-4e72-4a79-9f30-3e41b0064231" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:22 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-quobyte-68ac8f6d-4e72-4a79-9f30-3e41b0064231" acquired by "delete_volume" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:22 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[85700812-6a16-4a6b-a5fe-1bbc4fd8cdfe]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:27:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-68ac8f6d-4e72-4a79-9f30-3e41b0064231 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:22 devstack sudo[106505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-68ac8f6d-4e72-4a79-9f30-3e41b0064231
Jun 06 01:27:22 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:23 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-68ac8f6d-4e72-4a79-9f30-3e41b0064231" returned: 0 in 0.670s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-68ac8f6d-4e72-4a79-9f30-3e41b0064231 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:23 devstack sudo[106511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-68ac8f6d-4e72-4a79-9f30-3e41b0064231
Jun 06 01:27:23 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:23 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-68ac8f6d-4e72-4a79-9f30-3e41b0064231" returned: 0 in 0.596s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-quobyte-68ac8f6d-4e72-4a79-9f30-3e41b0064231" released by "delete_volume" :: held 1.299s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:23 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] Created reservations ['18c09b49-b7a5-472d-a468-9f274a7a9c71', '7803f616-9417-4019-a7cd-678ab2b047f5', '8db39dab-0748-4cbc-b68f-81130411378e', '353d37e5-15fc-4d0a-922e-fa35f15a0ec4'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:27:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:23 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:27:23 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:24 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.588s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:24 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:27:24 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] Deleted volume successfully.
Jun 06 01:27:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c78f0bb9-ed36-4fb1-8be4-d629748865e3 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-68ac8f6d-4e72-4a79-9f30-3e41b0064231-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "cinder-318b99c4-ca1e-4e07-aca3-4cad261cca4d-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-318b99c4-ca1e-4e07-aca3-4cad261cca4d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "cinder-quobyte-318b99c4-ca1e-4e07-aca3-4cad261cca4d" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-quobyte-318b99c4-ca1e-4e07-aca3-4cad261cca4d" acquired by "delete_volume" :: waited 0.013s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:24 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[320b65cb-3223-4cb9-b3e4-ff4c84f240c5]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:27:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-318b99c4-ca1e-4e07-aca3-4cad261cca4d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:24 devstack sudo[106519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-318b99c4-ca1e-4e07-aca3-4cad261cca4d
Jun 06 01:27:24 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:25 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-318b99c4-ca1e-4e07-aca3-4cad261cca4d" returned: 0 in 0.697s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-318b99c4-ca1e-4e07-aca3-4cad261cca4d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:25 devstack sudo[106524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-318b99c4-ca1e-4e07-aca3-4cad261cca4d
Jun 06 01:27:25 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:25 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-318b99c4-ca1e-4e07-aca3-4cad261cca4d" returned: 0 in 0.568s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-quobyte-318b99c4-ca1e-4e07-aca3-4cad261cca4d" released by "delete_volume" :: held 1.300s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:25 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] Created reservations ['8a47c644-86e8-4862-8367-1d13490731fd', '90f37ded-13b5-47a9-89b3-73fadbdde85c', 'ec87155e-b5e7-44be-8c20-d933b067dbfd', '225b3eec-138a-46d5-b638-9f5a34d7629b'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:27:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:25 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:26 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:26 devstack sudo[106528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:27:26 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:26 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.586s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:26 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:27:26 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] Deleted volume successfully.
Jun 06 01:27:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8feddc3d-1f9c-4ccf-b740-42c20847b2d9 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-318b99c4-ca1e-4e07-aca3-4cad261cca4d-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "cinder-f992af06-5f43-4d63-a711-c95f11817b4d-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-f992af06-5f43-4d63-a711-c95f11817b4d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "cinder-quobyte-f992af06-5f43-4d63-a711-c95f11817b4d" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-quobyte-f992af06-5f43-4d63-a711-c95f11817b4d" acquired by "delete_volume" :: waited 0.013s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:26 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72e37e7-5313-47fb-ba87-f8aaa6688714]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:27:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f992af06-5f43-4d63-a711-c95f11817b4d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:26 devstack sudo[106532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f992af06-5f43-4d63-a711-c95f11817b4d
Jun 06 01:27:26 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:27 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f992af06-5f43-4d63-a711-c95f11817b4d" returned: 0 in 0.681s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f992af06-5f43-4d63-a711-c95f11817b4d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:27 devstack sudo[106537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f992af06-5f43-4d63-a711-c95f11817b4d
Jun 06 01:27:27 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:28 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-f992af06-5f43-4d63-a711-c95f11817b4d" returned: 0 in 0.575s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:28 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-quobyte-f992af06-5f43-4d63-a711-c95f11817b4d" released by "delete_volume" :: held 1.290s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:28 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] Created reservations ['973d42be-2c04-426e-a614-35d8b206b5fd', '250aa3c4-d2a2-4f32-9c5f-7c34a2099552', '6e87c918-9f29-46da-9d8f-cb00de1a409d', 'aaea3234-d1a4-4a96-a767-11e1553f1969'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:27:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:28 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:28 devstack sudo[106540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:27:28 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:28 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.594s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:28 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:27:28 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] Deleted volume successfully.
Jun 06 01:27:28 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-70c329da-63c3-422c-883f-bb89fef32bd8 tempest-CreateVolumesFromImageTest-621045993 None] Lock "cinder-f992af06-5f43-4d63-a711-c95f11817b4d-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:38 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=56,cinder:UPDATE=63,cinder:INSERT=19,cinder:DELETE=4 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:27:38 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=72,cinder:SELECT=40,cinder:INSERT=21,cinder:DELETE=8 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Flow 'volume_create_manager' (6c07f0db-312b-468c-a970-12914fc19db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400b8fff-ec37-481b-b854-a3f4f928da4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400b8fff-ec37-481b-b854-a3f4f928da4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-276955151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79076649-1c84-41e5-af12-9582836415a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba366e54c0e4da4a3775aec968d77da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:40Z,use_quota=True,user_id='e868bb518b6b4ce9b64f5ebb88fd7b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dabed808-bb15-43bb-82df-5308d2ea956d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dabed808-bb15-43bb-82df-5308d2ea956d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ceec1e3-e054-4ba7-9ea4-ed13a6d44b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ceec1e3-e054-4ba7-9ea4-ed13a6d44b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79076649-1c84-41e5-af12-9582836415a9', 'volume_name': 'volume-79076649-1c84-41e5-af12-9582836415a9', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5767c2f9-f3e8-4848-8be5-6b971ce4b23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5767c2f9-f3e8-4848-8be5-6b971ce4b23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88127da7-f301-42fd-b68d-b1859ba4e53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:40 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Volume 79076649-1c84-41e5-af12-9582836415a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79076649-1c84-41e5-af12-9582836415a9', 'volume_size': 1}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-276955151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79076649-1c84-41e5-af12-9582836415a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba366e54c0e4da4a3775aec968d77da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:40Z,use_quota=True,user_id='e868bb518b6b4ce9b64f5ebb88fd7b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Creating volume 79076649-1c84-41e5-af12-9582836415a9 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:27:40 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:40 devstack sudo[106582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9 1073741824
Jun 06 01:27:40 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Flow 'volume_create_manager' (2fdadc36-7342-4b8b-aba9-4dfff8d435a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85617e20-a34f-4ef9-983b-ad8d61c46d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85617e20-a34f-4ef9-983b-ad8d61c46d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1411697482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6feefb6-acbe-4662-b154-7b117f60c334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8bbc23aeba64d0b9c7b5d9dc1285b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:41Z,use_quota=True,user_id='c2011999dfd24e89a189738fd38a8cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0c1179-4f06-4f9f-8267-280205973053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0c1179-4f06-4f9f-8267-280205973053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47fd7143-ae14-4302-8a81-ae157e640c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47fd7143-ae14-4302-8a81-ae157e640c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6feefb6-acbe-4662-b154-7b117f60c334', 'volume_name': 'volume-e6feefb6-acbe-4662-b154-7b117f60c334', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9894d1-75ec-40d2-ae58-40de1671b138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9894d1-75ec-40d2-ae58-40de1671b138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8bed899-00ac-4e08-9b61-b90d4dfecb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:40 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume e6feefb6-acbe-4662-b154-7b117f60c334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6feefb6-acbe-4662-b154-7b117f60c334', 'volume_size': 1}
Jun 06 01:27:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Flow 'volume_create_manager' (1fdc015d-4a1e-46e2-b693-785a6bf279af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd00487-0059-4c96-8ce2-f7d39c974c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd00487-0059-4c96-8ce2-f7d39c974c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-30010697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6f0586-26af-4cc6-bb60-312e379e114d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299459149179479081ca673fe4cfa088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:41Z,use_quota=True,user_id='17afdf6263dd40929e933f0531fc8eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e95f68-4c60-4229-a083-4e7cf509fd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e95f68-4c60-4229-a083-4e7cf509fd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6e2f9e-2dbb-4f21-8a76-70a1dcd9a983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6e2f9e-2dbb-4f21-8a76-70a1dcd9a983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea6f0586-26af-4cc6-bb60-312e379e114d', 'volume_name': 'volume-ea6f0586-26af-4cc6-bb60-312e379e114d', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f582384d-1661-46f2-8d2c-169f0203e83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f582384d-1661-46f2-8d2c-169f0203e83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b441da-fb95-4d38-8f34-5bc4e20124b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:41 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Volume ea6f0586-26af-4cc6-bb60-312e379e114d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea6f0586-26af-4cc6-bb60-312e379e114d', 'volume_size': 1}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Flow 'volume_create_manager' (88e8961e-756b-4897-a88c-b1d33928ebdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f213bec-a17e-4087-bef6-7ef67624ee15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f213bec-a17e-4087-bef6-7ef67624ee15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1041776038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0f0231-498c-480c-ad63-668b70524b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299459149179479081ca673fe4cfa088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:41Z,use_quota=True,user_id='17afdf6263dd40929e933f0531fc8eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5578f0c-0746-41a3-8542-5c5227069240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5578f0c-0746-41a3-8542-5c5227069240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d02728-792a-4401-a9fd-69e7ea687804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d02728-792a-4401-a9fd-69e7ea687804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd0f0231-498c-480c-ad63-668b70524b1c', 'volume_name': 'volume-bd0f0231-498c-480c-ad63-668b70524b1c', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:41 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41da3fb8-c8e5-44e8-b17c-ccd228ff0873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41da3fb8-c8e5-44e8-b17c-ccd228ff0873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8c26d0-55b5-4c5d-bc00-6357f6122479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:41 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Volume bd0f0231-498c-480c-ad63-668b70524b1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd0f0231-498c-480c-ad63-668b70524b1c', 'volume_size': 1}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9 1073741824" returned: 0 in 0.943s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:41 devstack sudo[106588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9
Jun 06 01:27:41 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Flow 'volume_create_manager' (db7d8e75-2618-488c-ad7a-f41c8c2cf701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933cbf1f-b6c7-4e53-8cfc-b0c52020cb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933cbf1f-b6c7-4e53-8cfc-b0c52020cb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-675471514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b5916b-92f4-434d-aff3-38b915229663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299459149179479081ca673fe4cfa088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:42Z,use_quota=True,user_id='17afdf6263dd40929e933f0531fc8eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa63fa79-fc19-40c0-a411-559b9ba245f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa63fa79-fc19-40c0-a411-559b9ba245f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6708e03-8ca9-4b88-8d58-a0ee62561e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6708e03-8ca9-4b88-8d58-a0ee62561e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b5916b-92f4-434d-aff3-38b915229663', 'volume_name': 'volume-18b5916b-92f4-434d-aff3-38b915229663', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe15217-febd-4750-8a48-83fddf896a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe15217-febd-4750-8a48-83fddf896a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3298b943-a391-42d6-aa14-04bf517781b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:42 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Volume 18b5916b-92f4-434d-aff3-38b915229663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b5916b-92f4-434d-aff3-38b915229663', 'volume_size': 1}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:42 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9" returned: 0 in 0.681s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.497s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1411697482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6feefb6-acbe-4662-b154-7b117f60c334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8bbc23aeba64d0b9c7b5d9dc1285b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:41Z,use_quota=True,user_id='c2011999dfd24e89a189738fd38a8cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Creating volume e6feefb6-acbe-4662-b154-7b117f60c334 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:27:42 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e6feefb6-acbe-4662-b154-7b117f60c334 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:42 devstack sudo[106591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e6feefb6-acbe-4662-b154-7b117f60c334 1073741824
Jun 06 01:27:42 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88127da7-f301-42fd-b68d-b1859ba4e53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79076649-1c84-41e5-af12-9582836415a9', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d697c95-bc6d-4f38-b46b-19f6ed0af4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Flow 'volume_create_manager' (e11b1d8a-a0e1-445f-90ca-829200e5539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2127b72-43e6-4cb4-99e9-c3c00a3508e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:42 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Volume volume-79076649-1c84-41e5-af12-9582836415a9 (79076649-1c84-41e5-af12-9582836415a9): created successfully
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d697c95-bc6d-4f38-b46b-19f6ed0af4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Flow 'volume_create_manager' (6c07f0db-312b-468c-a970-12914fc19db6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:42 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-95ef4052-a5c7-44f5-bb17-eb8c57e9f091 tempest-VolumeDependencyTests-636815276 None] Created volume successfully.
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2127b72-43e6-4cb4-99e9-c3c00a3508e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-81708540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d603768b-b08b-4e18-9a74-9bbb8a81c638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299459149179479081ca673fe4cfa088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:42Z,use_quota=True,user_id='17afdf6263dd40929e933f0531fc8eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab35365-e498-497c-bbb6-0deae2b45d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab35365-e498-497c-bbb6-0deae2b45d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6cf791-7b41-4c59-89c7-aa4d843d9dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6cf791-7b41-4c59-89c7-aa4d843d9dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd603768b-b08b-4e18-9a74-9bbb8a81c638', 'volume_name': 'volume-d603768b-b08b-4e18-9a74-9bbb8a81c638', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f31456a-1c17-419a-897c-e49e90aa9806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f31456a-1c17-419a-897c-e49e90aa9806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79788230-7010-4b60-8ef3-1ad5ee67323e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:42 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Volume d603768b-b08b-4e18-9a74-9bbb8a81c638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d603768b-b08b-4e18-9a74-9bbb8a81c638', 'volume_size': 1}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Flow 'volume_create_manager' (0f99d2b3-e934-4c7f-9197-e26dfeecf5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81be30b6-2fed-46b2-ace7-6349b4a49702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81be30b6-2fed-46b2-ace7-6349b4a49702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1819888213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76793e23-22cf-4c76-a453-b0f96a29a508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299459149179479081ca673fe4cfa088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:43Z,use_quota=True,user_id='17afdf6263dd40929e933f0531fc8eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f4902e-1738-40a7-9944-e6391948b6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f4902e-1738-40a7-9944-e6391948b6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4983dd5e-9766-46c7-9043-3429eb993c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4983dd5e-9766-46c7-9043-3429eb993c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76793e23-22cf-4c76-a453-b0f96a29a508', 'volume_name': 'volume-76793e23-22cf-4c76-a453-b0f96a29a508', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef7bd36-a1dc-4db5-a846-57d805602e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef7bd36-a1dc-4db5-a846-57d805602e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980278cd-7b19-4644-b22c-1879e869a0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:42 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Volume 76793e23-22cf-4c76-a453-b0f96a29a508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76793e23-22cf-4c76-a453-b0f96a29a508', 'volume_size': 1}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:43 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e6feefb6-acbe-4662-b154-7b117f60c334 1073741824" returned: 0 in 1.006s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e6feefb6-acbe-4662-b154-7b117f60c334 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:43 devstack sudo[106598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e6feefb6-acbe-4662-b154-7b117f60c334
Jun 06 01:27:43 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:43 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e6feefb6-acbe-4662-b154-7b117f60c334" returned: 0 in 0.592s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:27:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.759s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-30010697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6f0586-26af-4cc6-bb60-312e379e114d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299459149179479081ca673fe4cfa088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:41Z,use_quota=True,user_id='17afdf6263dd40929e933f0531fc8eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:27:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Creating volume ea6f0586-26af-4cc6-bb60-312e379e114d {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:27:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:43 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:27:43 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:27:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ea6f0586-26af-4cc6-bb60-312e379e114d 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:44 devstack sudo[106601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ea6f0586-26af-4cc6-bb60-312e379e114d 1073741824
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8bed899-00ac-4e08-9b61-b90d4dfecb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6feefb6-acbe-4662-b154-7b117f60c334', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:44 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb38268-c78f-414b-989e-2ceb2997cc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:44 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume volume-e6feefb6-acbe-4662-b154-7b117f60c334 (e6feefb6-acbe-4662-b154-7b117f60c334): created successfully
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb38268-c78f-414b-989e-2ceb2997cc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Flow 'volume_create_manager' (2fdadc36-7342-4b8b-aba9-4dfff8d435a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:44 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-0cfba1ca-57dc-492e-853b-3db0ab1ab6a5 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Created volume successfully.
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Flow 'volume_create_manager' (3a9cadec-cdd6-4424-a342-b6fc2e4179dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101a9bfb-ff15-41b2-89c0-1f79f0084757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101a9bfb-ff15-41b2-89c0-1f79f0084757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8581998-6187-4236-934a-7aa3d92a228f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e02786291834a9194f97306c76c5e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:44Z,use_quota=True,user_id='ef57395245ff4cbfb5145da763b36f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c148d8e2-149b-4a85-9584-6eb70e6fad2e),volume_type_id=c148d8e2-149b-4a85-9584-6eb70e6fad2e)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bdb805c-d9dd-4130-b3a5-f5310a8c49ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bdb805c-d9dd-4130-b3a5-f5310a8c49ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc7a408-47ba-46c3-af83-147da6ba3bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.image.glance [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Creating Keystone auth plugin from conf {{(pid=86581) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc7a408-47ba-46c3-af83-147da6ba3bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8581998-6187-4236-934a-7aa3d92a228f', 'volume_name': 'volume-a8581998-6187-4236-934a-7aa3d92a228f', 'volume_size': 1, 'image_id': '9506ca39-a7b3-48d6-8768-fc47a14aa0e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9506ca39-a7b3-48d6-8768-fc47a14aa0e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8823f998d2749a6ce1f480bac6266ef7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e02786291834a9194f97306c76c5e1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '92ba0e12c3456c7e2130ad396338b0d309dbfdeccd5da5b8cd4e0f79738ee922c1f18158d595d53f404d1d0c1917422ff71e1630d4806ab9cceecc6bb38ab520', 'id': '9506ca39-a7b3-48d6-8768-fc47a14aa0e8', 'created_at': datetime.datetime(2026, 6, 5, 23, 27, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 23, 27, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9506ca39-a7b3-48d6-8768-fc47a14aa0e8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x792698970890>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29a5324-5bfd-4f3d-afbe-a242c8d69aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29a5324-5bfd-4f3d-afbe-a242c8d69aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ebfd448-682c-4572-a160-e8138fbd3fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:44 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Volume a8581998-6187-4236-934a-7aa3d92a228f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8581998-6187-4236-934a-7aa3d92a228f', 'volume_size': 1, 'image_id': '9506ca39-a7b3-48d6-8768-fc47a14aa0e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9506ca39-a7b3-48d6-8768-fc47a14aa0e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8823f998d2749a6ce1f480bac6266ef7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e02786291834a9194f97306c76c5e1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '92ba0e12c3456c7e2130ad396338b0d309dbfdeccd5da5b8cd4e0f79738ee922c1f18158d595d53f404d1d0c1917422ff71e1630d4806ab9cceecc6bb38ab520', 'id': '9506ca39-a7b3-48d6-8768-fc47a14aa0e8', 'created_at': datetime.datetime(2026, 6, 5, 23, 27, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 23, 27, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9506ca39-a7b3-48d6-8768-fc47a14aa0e8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x792698970890>}
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Trying to clone a8581998-6187-4236-934a-7aa3d92a228f from image 9506ca39-a7b3-48d6-8768-fc47a14aa0e8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9506ca39-a7b3-48d6-8768-fc47a14aa0e8', 'metadata': {}}]). {{(pid=86581) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jun 06 01:27:44 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Image download 0.00 MB at 0.00 MB/s
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[42768014-f03c-4690-8171-107af8de012a]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:44 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ea6f0586-26af-4cc6-bb60-312e379e114d 1073741824" returned: 0 in 0.795s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ea6f0586-26af-4cc6-bb60-312e379e114d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:44 devstack sudo[106608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ea6f0586-26af-4cc6-bb60-312e379e114d
Jun 06 01:27:44 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:44 devstack sudo[106607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD
Jun 06 01:27:44 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Flow 'volume_create_manager' (51d1ecfc-ecde-40f5-aaa8-1baed74725e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16296e40-660d-415a-af45-d046d9ff64c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:45 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD" returned: 0 in 0.729s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16296e40-660d-415a-af45-d046d9ff64c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-53570861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca858b81-c2f4-4764-805c-0a24c3b62a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8bbc23aeba64d0b9c7b5d9dc1285b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:45Z,use_quota=True,user_id='c2011999dfd24e89a189738fd38a8cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f794c9-9620-4dbb-b3ba-06bb6c1565c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f794c9-9620-4dbb-b3ba-06bb6c1565c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e410d4-6202-4d47-9a64-11abece5a530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:45 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e410d4-6202-4d47-9a64-11abece5a530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca858b81-c2f4-4764-805c-0a24c3b62a0c', 'volume_name': 'volume-ca858b81-c2f4-4764-805c-0a24c3b62a0c', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f732579e-1528-4f47-b417-c883e669f799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f732579e-1528-4f47-b417-c883e669f799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54dd0064-92cc-42a3-9a14-a339f2d00b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:45 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume ca858b81-c2f4-4764-805c-0a24c3b62a0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca858b81-c2f4-4764-805c-0a24c3b62a0c', 'volume_size': 1}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ea6f0586-26af-4cc6-bb60-312e379e114d" returned: 0 in 0.741s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.964s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1041776038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0f0231-498c-480c-ad63-668b70524b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299459149179479081ca673fe4cfa088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:41Z,use_quota=True,user_id='17afdf6263dd40929e933f0531fc8eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Creating volume bd0f0231-498c-480c-ad63-668b70524b1c {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:27:45 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bd0f0231-498c-480c-ad63-668b70524b1c 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b441da-fb95-4d38-8f34-5bc4e20124b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea6f0586-26af-4cc6-bb60-312e379e114d', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810fa1c1-a880-41c1-9189-7364846dd80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:45 devstack sudo[106615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bd0f0231-498c-480c-ad63-668b70524b1c 1073741824
Jun 06 01:27:45 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:45 devstack sudo[106614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD
Jun 06 01:27:45 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:45 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Volume volume-ea6f0586-26af-4cc6-bb60-312e379e114d (ea6f0586-26af-4cc6-bb60-312e379e114d): created successfully
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810fa1c1-a880-41c1-9189-7364846dd80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Flow 'volume_create_manager' (1fdc015d-4a1e-46e2-b693-785a6bf279af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:45 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-9b2cd268-46cf-4125-bf30-8a1017383d95 tempest-CreateVolumesFromImageTest-1287896120 None] Created volume successfully.
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Flow 'volume_create_manager' (73b11e9f-df31-4249-9652-27f8d4d745b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400abd60-84c3-4b67-85c4-7dc1f5bb7e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400abd60-84c3-4b67-85c4-7dc1f5bb7e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-295593032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d6498c-3274-426e-8409-89844fa0c9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8bbc23aeba64d0b9c7b5d9dc1285b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:46Z,use_quota=True,user_id='c2011999dfd24e89a189738fd38a8cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e429f76-475b-48c8-8f44-e738eaf77d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e429f76-475b-48c8-8f44-e738eaf77d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b148c037-245a-472c-8b69-d62b5aa6194f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b148c037-245a-472c-8b69-d62b5aa6194f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2d6498c-3274-426e-8409-89844fa0c9fa', 'volume_name': 'volume-b2d6498c-3274-426e-8409-89844fa0c9fa', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d3001c-05f0-4c73-b481-d2eeb2b68fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d3001c-05f0-4c73-b481-d2eeb2b68fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b4b3ee-c691-4947-a7fd-529dbe31136f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:45 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume b2d6498c-3274-426e-8409-89844fa0c9fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2d6498c-3274-426e-8409-89844fa0c9fa', 'volume_size': 1}
Jun 06 01:27:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:46 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Flow 'volume_create_manager' (52e4c8b4-9609-419f-86b9-62c26581a7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50a9fb1-5dbf-49ea-ad25-0a5d24d8e2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD" returned: 1 in 0.794s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Temporary image 9506ca39-a7b3-48d6-8768-fc47a14aa0e8 is fetched for user ef57395245ff4cbfb5145da763b36f8f. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50a9fb1-5dbf-49ea-ad25-0a5d24d8e2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1594532683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4456b3a-b0d1-4e4a-92be-524d8fdec670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8bbc23aeba64d0b9c7b5d9dc1285b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:46Z,use_quota=True,user_id='c2011999dfd24e89a189738fd38a8cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb03560-8ae5-4cda-aee9-7b132de8f902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb03560-8ae5-4cda-aee9-7b132de8f902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caea85ec-f662-4185-bcaf-b8d7f25a1ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caea85ec-f662-4185-bcaf-b8d7f25a1ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4456b3a-b0d1-4e4a-92be-524d8fdec670', 'volume_name': 'volume-d4456b3a-b0d1-4e4a-92be-524d8fdec670', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3776f77-e5da-407a-8bd7-af107e2a8a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3776f77-e5da-407a-8bd7-af107e2a8a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848d3383-0f35-46ed-925c-4fc8a6a9d7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:46 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume d4456b3a-b0d1-4e4a-92be-524d8fdec670: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4456b3a-b0d1-4e4a-92be-524d8fdec670', 'volume_size': 1}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae486bba-696b-4153-a59a-ecde8fe92369]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:46 devstack sudo[106625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD
Jun 06 01:27:46 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:46 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bd0f0231-498c-480c-ad63-668b70524b1c 1073741824" returned: 0 in 0.973s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bd0f0231-498c-480c-ad63-668b70524b1c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:46 devstack sudo[106627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bd0f0231-498c-480c-ad63-668b70524b1c
Jun 06 01:27:46 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Flow 'volume_create_manager' (323a8d21-b817-4d08-b515-086b8fe958ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e63ca4-e0e8-4f05-9fae-057ed088e72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e63ca4-e0e8-4f05-9fae-057ed088e72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-249878201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf6ec8b-42b3-4c4a-8f9f-b5f331939506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8bbc23aeba64d0b9c7b5d9dc1285b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:47Z,use_quota=True,user_id='c2011999dfd24e89a189738fd38a8cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f2ad58-98d2-4731-aeed-42b6372b8ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f2ad58-98d2-4731-aeed-42b6372b8ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d2eed8-b933-44fd-a42c-971d6fb4b6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d2eed8-b933-44fd-a42c-971d6fb4b6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bf6ec8b-42b3-4c4a-8f9f-b5f331939506', 'volume_name': 'volume-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9dc661-0d94-4387-824f-d7ca67ecf8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9dc661-0d94-4387-824f-d7ca67ecf8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c745ed3-edc5-440e-9d23-5a5637bf7166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:46 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume 0bf6ec8b-42b3-4c4a-8f9f-b5f331939506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506', 'volume_size': 1}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Flow 'volume_create_manager' (aa30c6a5-f2e4-4654-9da7-82e7c6956e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe9ca1d-e6ee-437a-9d88-0790df4a9009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe9ca1d-e6ee-437a-9d88-0790df4a9009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1913725966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2dd868-6908-4112-b529-e51d2d95b0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8bbc23aeba64d0b9c7b5d9dc1285b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:47Z,use_quota=True,user_id='c2011999dfd24e89a189738fd38a8cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea4fb46-6443-4cc6-8c8f-e0bcad6d14dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea4fb46-6443-4cc6-8c8f-e0bcad6d14dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867780bd-5d6d-4be7-8316-c77084c43718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867780bd-5d6d-4be7-8316-c77084c43718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b2dd868-6908-4112-b529-e51d2d95b0e2', 'volume_name': 'volume-6b2dd868-6908-4112-b529-e51d2d95b0e2', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7675518-1872-489f-97f5-e59484a6664b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7675518-1872-489f-97f5-e59484a6664b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e968648-a7d3-4824-a838-72aae8621046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:47 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume 6b2dd868-6908-4112-b529-e51d2d95b0e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b2dd868-6908-4112-b529-e51d2d95b0e2', 'volume_size': 1}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:47 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bd0f0231-498c-480c-ad63-668b70524b1c" returned: 0 in 0.646s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.242s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-675471514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b5916b-92f4-434d-aff3-38b915229663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299459149179479081ca673fe4cfa088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:42Z,use_quota=True,user_id='17afdf6263dd40929e933f0531fc8eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Creating volume 18b5916b-92f4-434d-aff3-38b915229663 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:27:47 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-18b5916b-92f4-434d-aff3-38b915229663 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:47 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD" returned: 0 in 0.891s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:47 devstack sudo[106632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-18b5916b-92f4-434d-aff3-38b915229663 1073741824
Jun 06 01:27:47 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8c26d0-55b5-4c5d-bc00-6357f6122479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0f0231-498c-480c-ad63-668b70524b1c', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f116f3-2e99-4fd6-85c3-b915975cc265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:47 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Volume volume-bd0f0231-498c-480c-ad63-668b70524b1c (bd0f0231-498c-480c-ad63-668b70524b1c): created successfully
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f116f3-2e99-4fd6-85c3-b915975cc265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Flow 'volume_create_manager' (88e8961e-756b-4897-a88c-b1d33928ebdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:47 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-a40388e7-c283-4207-b9c0-a7b52f055d52 tempest-CreateVolumesFromImageTest-1287896120 None] Created volume successfully.
Jun 06 01:27:47 devstack sudo[106633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD
Jun 06 01:27:47 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:47 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD" returned: 1 in 0.692s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:27:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:48 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-18b5916b-92f4-434d-aff3-38b915229663 1073741824" returned: 0 in 0.772s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-18b5916b-92f4-434d-aff3-38b915229663 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:48 devstack sudo[106643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-18b5916b-92f4-434d-aff3-38b915229663
Jun 06 01:27:48 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:48 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-18b5916b-92f4-434d-aff3-38b915229663" returned: 0 in 0.587s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.137s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-81708540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d603768b-b08b-4e18-9a74-9bbb8a81c638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299459149179479081ca673fe4cfa088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:42Z,use_quota=True,user_id='17afdf6263dd40929e933f0531fc8eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Creating volume d603768b-b08b-4e18-9a74-9bbb8a81c638 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:27:48 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d603768b-b08b-4e18-9a74-9bbb8a81c638 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3298b943-a391-42d6-aa14-04bf517781b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b5916b-92f4-434d-aff3-38b915229663', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:48 devstack sudo[106646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d603768b-b08b-4e18-9a74-9bbb8a81c638 1073741824
Jun 06 01:27:48 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442bd21b-483f-46fa-a1f1-6c3f70475c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:48 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Volume volume-18b5916b-92f4-434d-aff3-38b915229663 (18b5916b-92f4-434d-aff3-38b915229663): created successfully
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442bd21b-483f-46fa-a1f1-6c3f70475c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Flow 'volume_create_manager' (db7d8e75-2618-488c-ad7a-f41c8c2cf701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:48 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-74f4fe1e-28af-42ae-98b8-26689a9fbcf3 tempest-CreateVolumesFromImageTest-1287896120 None] Created volume successfully.
Jun 06 01:27:49 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d603768b-b08b-4e18-9a74-9bbb8a81c638 1073741824" returned: 0 in 0.767s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d603768b-b08b-4e18-9a74-9bbb8a81c638 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:49 devstack sudo[106651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d603768b-b08b-4e18-9a74-9bbb8a81c638
Jun 06 01:27:49 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:50 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d603768b-b08b-4e18-9a74-9bbb8a81c638" returned: 0 in 0.598s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.191s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1819888213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76793e23-22cf-4c76-a453-b0f96a29a508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299459149179479081ca673fe4cfa088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:43Z,use_quota=True,user_id='17afdf6263dd40929e933f0531fc8eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Creating volume 76793e23-22cf-4c76-a453-b0f96a29a508 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:27:50 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-76793e23-22cf-4c76-a453-b0f96a29a508 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79788230-7010-4b60-8ef3-1ad5ee67323e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d603768b-b08b-4e18-9a74-9bbb8a81c638', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:50 devstack sudo[106654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-76793e23-22cf-4c76-a453-b0f96a29a508 1073741824
Jun 06 01:27:50 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3d7cb7-d2e3-43ba-a9be-59e705cbfe22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:50 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Volume volume-d603768b-b08b-4e18-9a74-9bbb8a81c638 (d603768b-b08b-4e18-9a74-9bbb8a81c638): created successfully
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3d7cb7-d2e3-43ba-a9be-59e705cbfe22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Flow 'volume_create_manager' (e11b1d8a-a0e1-445f-90ca-829200e5539d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:50 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-8467a744-0506-47ce-8a26-ec0659f9f904 tempest-CreateVolumesFromImageTest-1287896120 None] Created volume successfully.
Jun 06 01:27:50 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-76793e23-22cf-4c76-a453-b0f96a29a508 1073741824" returned: 0 in 0.760s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-76793e23-22cf-4c76-a453-b0f96a29a508 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:50 devstack sudo[106659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-76793e23-22cf-4c76-a453-b0f96a29a508
Jun 06 01:27:50 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:51 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-76793e23-22cf-4c76-a453-b0f96a29a508" returned: 0 in 0.589s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:27:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.520s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980278cd-7b19-4644-b22c-1879e869a0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76793e23-22cf-4c76-a453-b0f96a29a508', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b852ca81-4eee-427d-95a3-eb510b470208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:51 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] Creating offline snapshot 33793b34-7485-4d84-a6d9-aeec740d71d0 of volume 79076649-1c84-41e5-af12-9582836415a9 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:27:51 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Volume volume-76793e23-22cf-4c76-a453-b0f96a29a508 (76793e23-22cf-4c76-a453-b0f96a29a508): created successfully
Jun 06 01:27:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b852ca81-4eee-427d-95a3-eb510b470208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:51 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Flow 'volume_create_manager' (0f99d2b3-e934-4c7f-9197-e26dfeecf5a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:51 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1e620f-bdf5-412e-9021-2a160c466ab5]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:27:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:51 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-ac07734e-488f-479e-8861-aa098834449d tempest-CreateVolumesFromImageTest-1287896120 None] Created volume successfully.
Jun 06 01:27:51 devstack sudo[106662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9
Jun 06 01:27:51 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:52 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9" returned: 0 in 0.719s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:52 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0 1G
Jun 06 01:27:52 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:52 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "cinder-76793e23-22cf-4c76-a453-b0f96a29a508-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:52 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-76793e23-22cf-4c76-a453-b0f96a29a508-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:52 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "cinder-quobyte-76793e23-22cf-4c76-a453-b0f96a29a508" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:52 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-quobyte-76793e23-22cf-4c76-a453-b0f96a29a508" acquired by "delete_volume" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:52 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[3253b2b7-6528-452a-ba6d-1495182332db]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:27:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-76793e23-22cf-4c76-a453-b0f96a29a508 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:52 devstack sudo[106669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-76793e23-22cf-4c76-a453-b0f96a29a508
Jun 06 01:27:52 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:52 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0 1G" returned: 0 in 0.734s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79076649-1c84-41e5-af12-9582836415a9 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:53 devstack sudo[106674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79076649-1c84-41e5-af12-9582836415a9 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0
Jun 06 01:27:53 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:53 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-76793e23-22cf-4c76-a453-b0f96a29a508" returned: 0 in 0.734s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-76793e23-22cf-4c76-a453-b0f96a29a508 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:53 devstack sudo[106680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-76793e23-22cf-4c76-a453-b0f96a29a508
Jun 06 01:27:53 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:53 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79076649-1c84-41e5-af12-9582836415a9 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0" returned: 0 in 0.654s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:53 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0 is being set with open permissions: ugo+rw
Jun 06 01:27:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:53 devstack sudo[106685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0
Jun 06 01:27:53 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:54 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-76793e23-22cf-4c76-a453-b0f96a29a508" returned: 0 in 0.625s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-quobyte-76793e23-22cf-4c76-a453-b0f96a29a508" released by "delete_volume" :: held 1.411s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] Created reservations ['9639b3a3-5dbf-41ea-9d97-1b4506859d08', 'cdf18ae0-aecf-4237-832f-14aadb38e81d', 'c031b07a-acfc-4193-ac9c-d2aaadf9df0b', '9b6c3f8e-566d-42bf-a5f8-8e53eb9469f9'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:54 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0" returned: 0 in 0.599s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:54 devstack sudo[106689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:27:54 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:54 devstack sudo[106691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.info
Jun 06 01:27:54 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:54 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.597s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:27:54 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] Deleted volume successfully.
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-26127d46-6bde-4f3e-bed4-40bb656b6a8d tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-76793e23-22cf-4c76-a453-b0f96a29a508-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "cinder-d603768b-b08b-4e18-9a74-9bbb8a81c638-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:54 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.info" returned: 0 in 0.603s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:54 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.info is being set with open permissions: ugo+rw
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-d603768b-b08b-4e18-9a74-9bbb8a81c638-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:54 devstack sudo[106695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.info
Jun 06 01:27:54 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "cinder-quobyte-d603768b-b08b-4e18-9a74-9bbb8a81c638" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-quobyte-d603768b-b08b-4e18-9a74-9bbb8a81c638" acquired by "delete_volume" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:55 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7532f4e-ebf5-4ff6-be6e-5f37aa30e914]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:27:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d603768b-b08b-4e18-9a74-9bbb8a81c638 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:55 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d603768b-b08b-4e18-9a74-9bbb8a81c638
Jun 06 01:27:55 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:55 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.info" returned: 0 in 0.622s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.043s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.955s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-53570861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca858b81-c2f4-4764-805c-0a24c3b62a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8bbc23aeba64d0b9c7b5d9dc1285b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:45Z,use_quota=True,user_id='c2011999dfd24e89a189738fd38a8cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:27:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Creating volume ca858b81-c2f4-4764-805c-0a24c3b62a0c {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:27:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:27:55 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:27:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ca858b81-c2f4-4764-805c-0a24c3b62a0c 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:55 devstack sudo[106700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ca858b81-c2f4-4764-805c-0a24c3b62a0c 1073741824
Jun 06 01:27:55 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:55 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d8269afb-2676-4e08-8909-99478f890762 tempest-VolumeDependencyTests-636815276 None] Create snapshot completed successfully
Jun 06 01:27:55 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d603768b-b08b-4e18-9a74-9bbb8a81c638" returned: 0 in 0.745s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d603768b-b08b-4e18-9a74-9bbb8a81c638 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:55 devstack sudo[106705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d603768b-b08b-4e18-9a74-9bbb8a81c638
Jun 06 01:27:55 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:56 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ca858b81-c2f4-4764-805c-0a24c3b62a0c 1073741824" returned: 0 in 0.757s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ca858b81-c2f4-4764-805c-0a24c3b62a0c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:56 devstack sudo[106711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ca858b81-c2f4-4764-805c-0a24c3b62a0c
Jun 06 01:27:56 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:56 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d603768b-b08b-4e18-9a74-9bbb8a81c638" returned: 0 in 0.616s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-quobyte-d603768b-b08b-4e18-9a74-9bbb8a81c638" released by "delete_volume" :: held 1.407s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:56 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] Created reservations ['d4a61ff1-9fc7-463f-8166-44639778edae', 'c45353d5-b268-4127-8353-ab9a92621631', '1ca9203f-e8c9-47b6-a037-a6c5ffc0630c', 'a48fe4a1-d948-4148-bf3f-6e438b992c03'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:27:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:56 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:56 devstack sudo[106713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:27:56 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:56 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:27:56 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Flow 'volume_create_manager' (78260e77-76ee-464c-b55b-10d8b9c741c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:56 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2ef852-7cd0-4b3f-8811-e6ede30c6d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ca858b81-c2f4-4764-805c-0a24c3b62a0c" returned: 0 in 0.674s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2ef852-7cd0-4b3f-8811-e6ede30c6d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-218084396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad64d379-5613-4324-bb50-975ef98d1906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba366e54c0e4da4a3775aec968d77da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=33793b34-7485-4d84-a6d9-aeec740d71d0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:57Z,use_quota=True,user_id='e868bb518b6b4ce9b64f5ebb88fd7b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf4334b-e492-426e-9a70-a2310c38af91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf4334b-e492-426e-9a70-a2310c38af91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea940c51-da6d-403b-8d50-fd9462e87cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea940c51-da6d-403b-8d50-fd9462e87cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad64d379-5613-4324-bb50-975ef98d1906', 'volume_name': 'volume-ad64d379-5613-4324-bb50-975ef98d1906', 'volume_size': 1, 'snapshot_id': '33793b34-7485-4d84-a6d9-aeec740d71d0'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f2fbb43-10ea-4ed9-aa22-2b3a815fe752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f2fbb43-10ea-4ed9-aa22-2b3a815fe752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6af087c-ec53-4265-96c2-d37b8a040c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:57 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Volume ad64d379-5613-4324-bb50-975ef98d1906: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad64d379-5613-4324-bb50-975ef98d1906', 'volume_size': 1, 'snapshot_id': '33793b34-7485-4d84-a6d9-aeec740d71d0'}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.095s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-295593032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d6498c-3274-426e-8409-89844fa0c9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8bbc23aeba64d0b9c7b5d9dc1285b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:46Z,use_quota=True,user_id='c2011999dfd24e89a189738fd38a8cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Creating volume b2d6498c-3274-426e-8409-89844fa0c9fa {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:27:57 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b2d6498c-3274-426e-8409-89844fa0c9fa 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54dd0064-92cc-42a3-9a14-a339f2d00b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca858b81-c2f4-4764-805c-0a24c3b62a0c', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:57 devstack sudo[106717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b2d6498c-3274-426e-8409-89844fa0c9fa 1073741824
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045b326d-4677-4f62-80a8-0343493452d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:57 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:57 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume volume-ca858b81-c2f4-4764-805c-0a24c3b62a0c (ca858b81-c2f4-4764-805c-0a24c3b62a0c): created successfully
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045b326d-4677-4f62-80a8-0343493452d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Flow 'volume_create_manager' (51d1ecfc-ecde-40f5-aaa8-1baed74725e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:57 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d712bb84-487d-4cd2-a692-001a820b4176 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Created volume successfully.
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "cinder-18b5916b-92f4-434d-aff3-38b915229663-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:57 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.678s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-18b5916b-92f4-434d-aff3-38b915229663-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:57 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] Deleted volume successfully.
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-508083d9-b7a2-4fb8-8dfa-5a21e675cbb4 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-d603768b-b08b-4e18-9a74-9bbb8a81c638-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "cinder-quobyte-18b5916b-92f4-434d-aff3-38b915229663" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-quobyte-18b5916b-92f4-434d-aff3-38b915229663" acquired by "delete_volume" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e55b279-f287-4f8a-855e-0ff0bd6de39a]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-18b5916b-92f4-434d-aff3-38b915229663 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:57 devstack sudo[106719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-18b5916b-92f4-434d-aff3-38b915229663
Jun 06 01:27:57 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:57 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b2d6498c-3274-426e-8409-89844fa0c9fa 1073741824" returned: 0 in 0.839s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b2d6498c-3274-426e-8409-89844fa0c9fa {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:57 devstack sudo[106729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b2d6498c-3274-426e-8409-89844fa0c9fa
Jun 06 01:27:57 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:58 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-18b5916b-92f4-434d-aff3-38b915229663" returned: 0 in 0.738s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-18b5916b-92f4-434d-aff3-38b915229663 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:58 devstack sudo[106731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-18b5916b-92f4-434d-aff3-38b915229663
Jun 06 01:27:58 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:58 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b2d6498c-3274-426e-8409-89844fa0c9fa" returned: 0 in 0.623s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.203s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1594532683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4456b3a-b0d1-4e4a-92be-524d8fdec670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8bbc23aeba64d0b9c7b5d9dc1285b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:46Z,use_quota=True,user_id='c2011999dfd24e89a189738fd38a8cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Creating volume d4456b3a-b0d1-4e4a-92be-524d8fdec670 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:27:58 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d4456b3a-b0d1-4e4a-92be-524d8fdec670 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:58 devstack sudo[106735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d4456b3a-b0d1-4e4a-92be-524d8fdec670 1073741824
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b4b3ee-c691-4947-a7fd-529dbe31136f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2d6498c-3274-426e-8409-89844fa0c9fa', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:58 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d929dc99-a7c4-42ac-9cbc-111ecfff2cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:27:58 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume volume-b2d6498c-3274-426e-8409-89844fa0c9fa (b2d6498c-3274-426e-8409-89844fa0c9fa): created successfully
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d929dc99-a7c4-42ac-9cbc-111ecfff2cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Flow 'volume_create_manager' (73b11e9f-df31-4249-9652-27f8d4d745b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:27:58 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-3551c4bd-f707-47f1-b893-c9dd772cc04a tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Created volume successfully.
Jun 06 01:27:58 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-18b5916b-92f4-434d-aff3-38b915229663" returned: 0 in 0.652s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-quobyte-18b5916b-92f4-434d-aff3-38b915229663" released by "delete_volume" :: held 1.437s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] Created reservations ['e97b450b-a410-4014-a9a0-8b42c7f00838', 'adc467c6-3c8c-4da0-8a3e-dc610e6c3f71', '8897e9cb-179e-439b-bd34-4ee2a8b4286a', 'a88cd062-d446-4392-8544-05eb07d6a2ab'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:58 devstack sudo[106738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:27:58 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:59 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d4456b3a-b0d1-4e4a-92be-524d8fdec670 1073741824" returned: 0 in 0.824s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:59 devstack sudo[106745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:27:59 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "cinder-bd0f0231-498c-480c-ad63-668b70524b1c-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-bd0f0231-498c-480c-ad63-668b70524b1c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:59 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d4456b3a-b0d1-4e4a-92be-524d8fdec670 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.664s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:27:59 devstack sudo[106747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d4456b3a-b0d1-4e4a-92be-524d8fdec670
Jun 06 01:27:59 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] Deleted volume successfully.
Jun 06 01:27:59 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "cinder-quobyte-bd0f0231-498c-480c-ad63-668b70524b1c" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7ba92a9b-2f27-4d89-acd7-93df99ef2762 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-18b5916b-92f4-434d-aff3-38b915229663-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-quobyte-bd0f0231-498c-480c-ad63-668b70524b1c" acquired by "delete_volume" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9fddb3-1943-4fb3-ab07-9746cd30346a]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:27:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bd0f0231-498c-480c-ad63-668b70524b1c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:27:59 devstack sudo[106749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bd0f0231-498c-480c-ad63-668b70524b1c
Jun 06 01:27:59 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:00 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.657s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:28:00 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d4456b3a-b0d1-4e4a-92be-524d8fdec670" returned: 0 in 0.701s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.400s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-249878201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf6ec8b-42b3-4c4a-8f9f-b5f331939506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8bbc23aeba64d0b9c7b5d9dc1285b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:47Z,use_quota=True,user_id='c2011999dfd24e89a189738fd38a8cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Creating volume 0bf6ec8b-42b3-4c4a-8f9f-b5f331939506 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:28:00 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:00 devstack sudo[106753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506 1073741824
Jun 06 01:28:00 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848d3383-0f35-46ed-925c-4fc8a6a9d7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4456b3a-b0d1-4e4a-92be-524d8fdec670', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2018117f-27d0-4b13-ba7a-59bfc920ea54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:00 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume volume-d4456b3a-b0d1-4e4a-92be-524d8fdec670 (d4456b3a-b0d1-4e4a-92be-524d8fdec670): created successfully
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2018117f-27d0-4b13-ba7a-59bfc920ea54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Flow 'volume_create_manager' (52e4c8b4-9609-419f-86b9-62c26581a7e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:00 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b7ae407b-ae66-4e5f-9861-1b9bade5fd47 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Created volume successfully.
Jun 06 01:28:00 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bd0f0231-498c-480c-ad63-668b70524b1c" returned: 0 in 0.788s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bd0f0231-498c-480c-ad63-668b70524b1c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:00 devstack sudo[106758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bd0f0231-498c-480c-ad63-668b70524b1c
Jun 06 01:28:00 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:00 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bd0f0231-498c-480c-ad63-668b70524b1c" returned: 0 in 0.624s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:01 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-quobyte-bd0f0231-498c-480c-ad63-668b70524b1c" released by "delete_volume" :: held 1.470s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506 1073741824" returned: 0 in 0.824s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:01 devstack sudo[106765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506
Jun 06 01:28:01 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] Created reservations ['a31aaa3e-279d-47be-8f16-667af6102505', 'd1a9ce15-157d-49a9-b359-26fde89d71b7', 'd7a84d1c-eaf7-4763-9858-e71e18bd4493', 'b5e32845-2004-4664-97d6-b8429e41bf06'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:01 devstack sudo[106767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:28:01 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "cinder-ea6f0586-26af-4cc6-bb60-312e379e114d-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-ea6f0586-26af-4cc6-bb60-312e379e114d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:01 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506" returned: 0 in 0.661s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.708s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1913725966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2dd868-6908-4112-b529-e51d2d95b0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8bbc23aeba64d0b9c7b5d9dc1285b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:47Z,use_quota=True,user_id='c2011999dfd24e89a189738fd38a8cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Creating volume 6b2dd868-6908-4112-b529-e51d2d95b0e2 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:01 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:28:01 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6b2dd868-6908-4112-b529-e51d2d95b0e2 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:01 devstack sudo[106771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6b2dd868-6908-4112-b529-e51d2d95b0e2 1073741824
Jun 06 01:28:01 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c745ed3-edc5-440e-9d23-5a5637bf7166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbfa3e5-05c3-45d4-a0ed-57cdb90348fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.625s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "cinder-quobyte-ea6f0586-26af-4cc6-bb60-312e379e114d" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:01 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] Deleted volume successfully.
Jun 06 01:28:01 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume volume-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506 (0bf6ec8b-42b3-4c4a-8f9f-b5f331939506): created successfully
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbfa3e5-05c3-45d4-a0ed-57cdb90348fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Flow 'volume_create_manager' (323a8d21-b817-4d08-b515-086b8fe958ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-quobyte-ea6f0586-26af-4cc6-bb60-312e379e114d" acquired by "delete_volume" :: waited 0.033s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9c6d937d-99f8-4693-9103-f696e5bc354a tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-bd0f0231-498c-480c-ad63-668b70524b1c-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:01 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c629e6c4-5482-49f3-90aa-dbb0287d0cfc tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Created volume successfully.
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[55be97b0-f4d3-4312-a386-c60f584880a6]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ea6f0586-26af-4cc6-bb60-312e379e114d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:01 devstack sudo[106773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ea6f0586-26af-4cc6-bb60-312e379e114d
Jun 06 01:28:01 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:02 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6b2dd868-6908-4112-b529-e51d2d95b0e2 1073741824" returned: 0 in 0.745s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6b2dd868-6908-4112-b529-e51d2d95b0e2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:02 devstack sudo[106781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6b2dd868-6908-4112-b529-e51d2d95b0e2
Jun 06 01:28:02 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:02 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ea6f0586-26af-4cc6-bb60-312e379e114d" returned: 0 in 0.757s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ea6f0586-26af-4cc6-bb60-312e379e114d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:02 devstack sudo[106783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ea6f0586-26af-4cc6-bb60-312e379e114d
Jun 06 01:28:02 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:03 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6b2dd868-6908-4112-b529-e51d2d95b0e2" returned: 0 in 0.606s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.121s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8581998-6187-4236-934a-7aa3d92a228f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e02786291834a9194f97306c76c5e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:27:44Z,use_quota=True,user_id='ef57395245ff4cbfb5145da763b36f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c148d8e2-149b-4a85-9584-6eb70e6fad2e),volume_type_id=c148d8e2-149b-4a85-9584-6eb70e6fad2e)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Creating volume a8581998-6187-4236-934a-7aa3d92a228f {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:28:03 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:03 devstack sudo[106787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f 1073741824
Jun 06 01:28:03 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e968648-a7d3-4824-a838-72aae8621046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b2dd868-6908-4112-b529-e51d2d95b0e2', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2d2260-bab3-4daf-98ee-62b17b1a3e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:03 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Volume volume-6b2dd868-6908-4112-b529-e51d2d95b0e2 (6b2dd868-6908-4112-b529-e51d2d95b0e2): created successfully
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2d2260-bab3-4daf-98ee-62b17b1a3e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Flow 'volume_create_manager' (aa30c6a5-f2e4-4654-9da7-82e7c6956e5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:03 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-386fa49a-f296-4550-aae9-604bb089b0bd tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Created volume successfully.
Jun 06 01:28:03 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ea6f0586-26af-4cc6-bb60-312e379e114d" returned: 0 in 0.614s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-quobyte-ea6f0586-26af-4cc6-bb60-312e379e114d" released by "delete_volume" :: held 1.425s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] Created reservations ['f3143aa3-c623-489c-9a33-4773824bbfc9', 'f9e3f018-b96d-4315-b640-cb4579d400f6', '50fc962f-4688-41c7-b4db-010cbd9c09b2', 'e7850c3d-27fd-47cf-b30b-be57c52cb9c6'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:03 devstack sudo[106789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:28:03 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:03 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.618s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:28:03 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] Deleted volume successfully.
Jun 06 01:28:03 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f 1073741824" returned: 0 in 0.836s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-092eff9e-74ae-4d34-a1f3-73df90948f19 tempest-CreateVolumesFromImageTest-1287896120 None] Lock "cinder-ea6f0586-26af-4cc6-bb60-312e379e114d-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:04 devstack sudo[106796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f
Jun 06 01:28:04 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "cinder-6b2dd868-6908-4112-b529-e51d2d95b0e2-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-6b2dd868-6908-4112-b529-e51d2d95b0e2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "cinder-quobyte-6b2dd868-6908-4112-b529-e51d2d95b0e2" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-quobyte-6b2dd868-6908-4112-b529-e51d2d95b0e2" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd3720d-e697-40a5-bdae-9598a949265b]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6b2dd868-6908-4112-b529-e51d2d95b0e2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:04 devstack sudo[106798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6b2dd868-6908-4112-b529-e51d2d95b0e2
Jun 06 01:28:04 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:04 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f" returned: 0 in 0.698s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.613s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Acquiring lock "cinder-quobyte-33793b34-7485-4d84-a6d9-aeec740d71d0-ad64d379-5613-4324-bb50-975ef98d1906" by "_create_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-quobyte-33793b34-7485-4d84-a6d9-aeec740d71d0-ad64d379-5613-4324-bb50-975ef98d1906" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Creating volume ad64d379-5613-4324-bb50-975ef98d1906 from snapshot 33793b34-7485-4d84-a6d9-aeec740d71d0 {{(pid=86581) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Acquiring lock "cinder-quobyte-ad64d379-5613-4324-bb50-975ef98d1906" by "_copy_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Attempting download of 9506ca39-a7b3-48d6-8768-fc47a14aa0e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/9506ca39-a7b3-48d6-8768-fc47a14aa0e8', 'metadata': {}}])) to volume a8581998-6187-4236-934a-7aa3d92a228f. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-quobyte-ad64d379-5613-4324-bb50-975ef98d1906" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] snapshot: 33793b34-7485-4d84-a6d9-aeec740d71d0, volume: ad64d379-5613-4324-bb50-975ef98d1906,  {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cee53c-cd32-41a9-a098-9d8886b4ba6e]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d63584-3dfa-49b2-ba35-538508f1b495]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9506ca39-a7b3-48d6-8768-fc47a14aa0e8__tl3l_ng {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:05 devstack sudo[106802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0
Jun 06 01:28:05 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:05 devstack sudo[106803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9506ca39-a7b3-48d6-8768-fc47a14aa0e8__tl3l_ng
Jun 06 01:28:05 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:05 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6b2dd868-6908-4112-b529-e51d2d95b0e2" returned: 0 in 0.858s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6b2dd868-6908-4112-b529-e51d2d95b0e2 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:05 devstack sudo[106809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6b2dd868-6908-4112-b529-e51d2d95b0e2
Jun 06 01:28:05 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:05 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9506ca39-a7b3-48d6-8768-fc47a14aa0e8__tl3l_ng" returned: 0 in 0.913s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9506ca39-a7b3-48d6-8768-fc47a14aa0e8__tl3l_ng {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:05 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0" returned: 0 in 0.947s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79076649-1c84-41e5-af12-9582836415a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:28:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9 {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 06 01:28:05 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Creating direct copy from snapshot {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 06 01:28:05 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59d8647-731a-4025-bd2f-6fd22155a539]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:05 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-6b2dd868-6908-4112-b529-e51d2d95b0e2" returned: 0 in 0.721s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-quobyte-6b2dd868-6908-4112-b529-e51d2d95b0e2" released by "delete_volume" :: held 1.637s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:05 devstack sudo[106817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9506ca39-a7b3-48d6-8768-fc47a14aa0e8__tl3l_ng
Jun 06 01:28:05 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:05 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Created reservations ['7acf6b27-1333-4074-9b02-01aa2df2e3b0', '37a5fd4c-8517-4f5c-a90f-225f214d07d3', '726edd42-c233-4d9d-bbee-7accc44eed90', '0cc67ba6-babe-4bac-b3a9-9478ba6a4cf4'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:05 devstack sudo[106818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9
Jun 06 01:28:05 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:06 devstack sudo[106821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:28:06 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "cinder-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "cinder-quobyte-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:06 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-quobyte-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506" acquired by "delete_volume" :: waited 0.027s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9506ca39-a7b3-48d6-8768-fc47a14aa0e8__tl3l_ng" returned: 1 in 0.844s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9506ca39-a7b3-48d6-8768-fc47a14aa0e8__tl3l_ng' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[387b8c87-44fc-44a3-ade2-8e79b650cf9d]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[970d19ce-7e56-4877-8569-5766c51abc7f]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:06 devstack sudo[106825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD
Jun 06 01:28:06 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:06 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.807s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:28:06 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Deleted volume successfully.
Jun 06 01:28:06 devstack sudo[106827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506
Jun 06 01:28:06 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7aaf1b69-e30f-4d4d-809a-a45ba4d90fe9 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-6b2dd868-6908-4112-b529-e51d2d95b0e2-delete_volume" released by "delete_volume" :: held 2.722s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:06 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9" returned: 0 in 1.079s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG cinder.utils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Path /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad64d379-5613-4324-bb50-975ef98d1906 not found in is_blk_device check {{(pid=86581) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jun 06 01:28:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad64d379-5613-4324-bb50-975ef98d1906 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:06 devstack sudo[106833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad64d379-5613-4324-bb50-975ef98d1906
Jun 06 01:28:06 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:07 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD" returned: 0 in 0.868s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:07 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506" returned: 0 in 0.955s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:07 devstack sudo[106843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD
Jun 06 01:28:07 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:07 devstack sudo[106845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506
Jun 06 01:28:07 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:08 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506" returned: 0 in 0.770s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:08 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-quobyte-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506" released by "delete_volume" :: held 1.803s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:08 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Created reservations ['9d47461c-f238-4bc4-8c7d-b8e5c39d8df2', '6ffb0f41-2801-4548-b0b4-2162672c2be2', 'de62619f-84c0-4986-a739-30822b99ae42', '13548a08-6e2a-45df-8057-f10cd31744ee'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:08 devstack sudo[106859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:28:08 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:09 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "cinder-d4456b3a-b0d1-4e4a-92be-524d8fdec670-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD" returned: 1 in 1.663s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:28:09 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] 9506ca39-a7b3-48d6-8768-fc47a14aa0e8 was raw, converting to raw {{(pid=86581) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jun 06 01:28:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:09 devstack sudo[106862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f
Jun 06 01:28:09 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-d4456b3a-b0d1-4e4a-92be-524d8fdec670-delete_volume" acquired by "delete_volume" :: waited 0.150s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "cinder-quobyte-d4456b3a-b0d1-4e4a-92be-524d8fdec670" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-quobyte-d4456b3a-b0d1-4e4a-92be-524d8fdec670" acquired by "delete_volume" :: waited 0.048s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:09 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb869ec9-cb9b-4ac3-8d9a-f461b9d33a18]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d4456b3a-b0d1-4e4a-92be-524d8fdec670 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:09 devstack sudo[106864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d4456b3a-b0d1-4e4a-92be-524d8fdec670
Jun 06 01:28:09 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:10 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.372s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:10 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:28:10 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Deleted volume successfully.
Jun 06 01:28:10 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bcb6c6fe-0bba-41e4-95a0-453a1448cb04 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-0bf6ec8b-42b3-4c4a-8f9f-b5f331939506-delete_volume" released by "delete_volume" :: held 3.832s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:11 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d4456b3a-b0d1-4e4a-92be-524d8fdec670" returned: 0 in 1.462s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d4456b3a-b0d1-4e4a-92be-524d8fdec670 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:11 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f" returned: 0 in 1.868s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:11 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9506ca39-a7b3-48d6-8768-fc47a14aa0e8_lhxyn4l3devstack@QuobyteHD, size 0.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:28:11 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Converted 0.00 MB image at 0.00 MB/s
Jun 06 01:28:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:11 devstack sudo[106873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d4456b3a-b0d1-4e4a-92be-524d8fdec670
Jun 06 01:28:11 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:11 devstack sudo[106875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f 1G
Jun 06 01:28:11 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:12 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f 1G" returned: 0 in 1.544s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:12 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb764766-c4ad-4659-bf8e-0310c6e3b055]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:12 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-d4456b3a-b0d1-4e4a-92be-524d8fdec670" returned: 0 in 1.802s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-quobyte-d4456b3a-b0d1-4e4a-92be-524d8fdec670" released by "delete_volume" :: held 3.371s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:12 devstack sudo[106881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f
Jun 06 01:28:13 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:13 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Created reservations ['fea6c1f5-52e5-4a9b-9b3e-9d9be67c9f10', 'a4c846d8-7def-49bb-86f0-c79d46ea69f5', 'a392cc2b-5807-45a2-a615-031f45850f68', 'c82c4e2e-812b-421b-9ddc-cbd01b5d4af3'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:13 devstack sudo[106883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:28:13 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:13 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad64d379-5613-4324-bb50-975ef98d1906" returned: 0 in 6.710s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:13 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc9106c-21fe-446d-8078-5fc9c74da835]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "cinder-b2d6498c-3274-426e-8409-89844fa0c9fa-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-b2d6498c-3274-426e-8409-89844fa0c9fa-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "cinder-quobyte-b2d6498c-3274-426e-8409-89844fa0c9fa" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-quobyte-b2d6498c-3274-426e-8409-89844fa0c9fa" acquired by "delete_volume" :: waited 0.027s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:13 devstack sudo[106886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9
Jun 06 01:28:13 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:13 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef8b31c-2c80-4212-8cbe-534b2d008a25]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b2d6498c-3274-426e-8409-89844fa0c9fa {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:14 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.878s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:14 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:28:14 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Deleted volume successfully.
Jun 06 01:28:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-d987e66b-c56c-4483-9b22-5db3410093e1 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-d4456b3a-b0d1-4e4a-92be-524d8fdec670-delete_volume" released by "delete_volume" :: held 4.827s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:14 devstack sudo[106889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b2d6498c-3274-426e-8409-89844fa0c9fa
Jun 06 01:28:14 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:14 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f" returned: 0 in 1.425s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:14 devstack sudo[106893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f
Jun 06 01:28:14 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:14 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9" returned: 0 in 1.239s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:14 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Image conversion details: src /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9, size 1024.00 MB, duration 6.71 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad64d379-5613-4324-bb50-975ef98d1906 {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:28:14 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Converted 1024.00 MB image at 152.58 MB/s
Jun 06 01:28:14 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad64d379-5613-4324-bb50-975ef98d1906 is being set with open permissions: ugo+rw
Jun 06 01:28:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad64d379-5613-4324-bb50-975ef98d1906 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:14 devstack sudo[106904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad64d379-5613-4324-bb50-975ef98d1906
Jun 06 01:28:14 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:14 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b2d6498c-3274-426e-8409-89844fa0c9fa" returned: 0 in 0.999s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b2d6498c-3274-426e-8409-89844fa0c9fa {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:14 devstack sudo[106907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b2d6498c-3274-426e-8409-89844fa0c9fa
Jun 06 01:28:14 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:15 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f" returned: 1 in 0.868s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Downloaded image 9506ca39-a7b3-48d6-8768-fc47a14aa0e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/9506ca39-a7b3-48d6-8768-fc47a14aa0e8', 'metadata': {}}])) to volume a8581998-6187-4236-934a-7aa3d92a228f successfully. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Temporary image 9506ca39-a7b3-48d6-8768-fc47a14aa0e8 for user ef57395245ff4cbfb5145da763b36f8f is deleted. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Marking volume a8581998-6187-4236-934a-7aa3d92a228f as bootable. {{(pid=86581) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Copying metadata from image 9506ca39-a7b3-48d6-8768-fc47a14aa0e8 to a8581998-6187-4236-934a-7aa3d92a228f. {{(pid=86581) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Creating volume glance metadata for volume a8581998-6187-4236-934a-7aa3d92a228f backed by image 9506ca39-a7b3-48d6-8768-fc47a14aa0e8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9506ca39-a7b3-48d6-8768-fc47a14aa0e8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8823f998d2749a6ce1f480bac6266ef7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86581) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ebfd448-682c-4572-a160-e8138fbd3fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8581998-6187-4236-934a-7aa3d92a228f', 'volume_size': 1, 'image_id': '9506ca39-a7b3-48d6-8768-fc47a14aa0e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9506ca39-a7b3-48d6-8768-fc47a14aa0e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8823f998d2749a6ce1f480bac6266ef7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e02786291834a9194f97306c76c5e1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '92ba0e12c3456c7e2130ad396338b0d309dbfdeccd5da5b8cd4e0f79738ee922c1f18158d595d53f404d1d0c1917422ff71e1630d4806ab9cceecc6bb38ab520', 'id': '9506ca39-a7b3-48d6-8768-fc47a14aa0e8', 'created_at': datetime.datetime(2026, 6, 5, 23, 27, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 23, 27, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9506ca39-a7b3-48d6-8768-fc47a14aa0e8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x792698970890>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44508be5-85a5-44b0-a049-f60c80d09044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:15 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Volume volume-a8581998-6187-4236-934a-7aa3d92a228f (a8581998-6187-4236-934a-7aa3d92a228f): created successfully
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44508be5-85a5-44b0-a049-f60c80d09044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Flow 'volume_create_manager' (3a9cadec-cdd6-4424-a342-b6fc2e4179dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:15 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-03b5d0c6-5693-4abf-9dfd-af936ba4bd72 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Created volume successfully.
Jun 06 01:28:15 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad64d379-5613-4324-bb50-975ef98d1906" returned: 0 in 0.624s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-quobyte-ad64d379-5613-4324-bb50-975ef98d1906" released by "_copy_volume_from_snapshot" :: held 10.773s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-quobyte-33793b34-7485-4d84-a6d9-aeec740d71d0-ad64d379-5613-4324-bb50-975ef98d1906" released by "_create_volume_from_snapshot" :: held 10.820s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.861s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6af087c-ec53-4265-96c2-d37b8a040c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad64d379-5613-4324-bb50-975ef98d1906', 'volume_size': 1, 'snapshot_id': '33793b34-7485-4d84-a6d9-aeec740d71d0'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:15 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7600e275-d48e-45ac-9fca-b790a2edf20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b2d6498c-3274-426e-8409-89844fa0c9fa" returned: 0 in 0.649s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:15 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Volume volume-ad64d379-5613-4324-bb50-975ef98d1906 (ad64d379-5613-4324-bb50-975ef98d1906): created successfully
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7600e275-d48e-45ac-9fca-b790a2edf20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Flow 'volume_create_manager' (78260e77-76ee-464c-b55b-10d8b9c741c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-quobyte-b2d6498c-3274-426e-8409-89844fa0c9fa" released by "delete_volume" :: held 1.716s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:15 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-15c55b43-a468-48c5-add4-a9cf094f9243 tempest-VolumeDependencyTests-636815276 None] Created volume successfully.
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Created reservations ['4bbff9cb-bcc4-47fe-8b35-f29ed43f49a7', 'f8e4881d-4b1b-4ab6-ac7e-02cfb6d80985', 'e4d96a6c-a02a-40c7-876f-0ccb67c2bf87', 'ecc19ff4-1a51-470d-bde8-3c566d76c19c'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] Acquiring lock "cinder-33793b34-7485-4d84-a6d9-aeec740d71d0-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-33793b34-7485-4d84-a6d9-aeec740d71d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] Acquiring lock "cinder-quobyte-79076649-1c84-41e5-af12-9582836415a9" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-quobyte-79076649-1c84-41e5-af12-9582836415a9" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] Acquiring lock "cinder-quobyte-33793b34-7485-4d84-a6d9-aeec740d71d0" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:15 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:28:15 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-quobyte-33793b34-7485-4d84-a6d9-aeec740d71d0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] Deleting offline snapshot 33793b34-7485-4d84-a6d9-aeec740d71d0 of volume 79076649-1c84-41e5-af12-9582836415a9 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] snapshot_file for this snap is: volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[984a15cb-8f5c-4f86-b24e-d9d8ca5b5f44]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Acquiring lock "cinder-a8581998-6187-4236-934a-7aa3d92a228f-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Lock "cinder-a8581998-6187-4236-934a-7aa3d92a228f-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:16 devstack sudo[106913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0
Jun 06 01:28:16 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Acquiring lock "cinder-quobyte-a8581998-6187-4236-934a-7aa3d92a228f" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "cinder-ca858b81-c2f4-4764-805c-0a24c3b62a0c-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Lock "cinder-quobyte-a8581998-6187-4236-934a-7aa3d92a228f" acquired by "delete_volume" :: waited 0.029s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-ca858b81-c2f4-4764-805c-0a24c3b62a0c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "cinder-quobyte-ca858b81-c2f4-4764-805c-0a24c3b62a0c" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:16 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[80308470-eb8e-45a6-979c-6566adeac250]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-quobyte-ca858b81-c2f4-4764-805c-0a24c3b62a0c" acquired by "delete_volume" :: waited 0.048s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:16 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f137dd-14e3-4bd0-82e8-6229cca3a9a4]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ca858b81-c2f4-4764-805c-0a24c3b62a0c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:16 devstack sudo[106915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f
Jun 06 01:28:16 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:16 devstack sudo[106916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ca858b81-c2f4-4764-805c-0a24c3b62a0c
Jun 06 01:28:16 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:16 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.990s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:16 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:28:16 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Deleted volume successfully.
Jun 06 01:28:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-3a35a54d-9f67-45b7-a36c-36a045d6e54c tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-b2d6498c-3274-426e-8409-89844fa0c9fa-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:17 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f" returned: 0 in 0.909s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:17 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0" returned: 0 in 1.394s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:17 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79076649-1c84-41e5-af12-9582836415a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:28:17 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8736cff-17cd-4bf7-8f57-16667864ca91]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:17 devstack sudo[106925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f
Jun 06 01:28:17 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:17 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ca858b81-c2f4-4764-805c-0a24c3b62a0c" returned: 0 in 1.037s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:17 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ca858b81-c2f4-4764-805c-0a24c3b62a0c {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:17 devstack sudo[106930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9
Jun 06 01:28:17 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:17 devstack sudo[106933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ca858b81-c2f4-4764-805c-0a24c3b62a0c
Jun 06 01:28:17 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:18 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ca858b81-c2f4-4764-805c-0a24c3b62a0c" returned: 0 in 0.673s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-quobyte-ca858b81-c2f4-4764-805c-0a24c3b62a0c" released by "delete_volume" :: held 1.787s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Created reservations ['585ab83f-36f3-4008-a646-44e14824f512', 'dad8677e-8590-471c-bead-8490c392501d', '9bfce34f-3e25-4602-95b5-c5cbbae61c10', '8e711bef-6543-4c7b-aab0-53c1fec329da'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:18 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f" returned: 1 in 1.102s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:18 devstack sudo[106984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f
Jun 06 01:28:18 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:18 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:18 devstack sudo[106987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9" returned: 0 in 1.096s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:18 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:18 devstack sudo[106989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0
Jun 06 01:28:18 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "cinder-e6feefb6-acbe-4662-b154-7b117f60c334-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-e6feefb6-acbe-4662-b154-7b117f60c334-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "cinder-quobyte-e6feefb6-acbe-4662-b154-7b117f60c334" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-quobyte-e6feefb6-acbe-4662-b154-7b117f60c334" acquired by "delete_volume" :: waited 0.039s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f7acf5-2dcb-4232-9f13-4e11467c8e58]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:18 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e6feefb6-acbe-4662-b154-7b117f60c334 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:18 devstack sudo[106991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e6feefb6-acbe-4662-b154-7b117f60c334
Jun 06 01:28:18 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:19 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.789s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:19 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:28:19 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Deleted volume successfully.
Jun 06 01:28:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-687743de-f6ec-467b-8ced-18c0b681ad95 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-ca858b81-c2f4-4764-805c-0a24c3b62a0c-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:19 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-a8581998-6187-4236-934a-7aa3d92a228f" returned: 0 in 0.902s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:19 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Lock "cinder-quobyte-a8581998-6187-4236-934a-7aa3d92a228f" released by "delete_volume" :: held 3.042s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:19 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Created reservations ['05b1acb2-0c72-403c-b7b0-85ed6c9ec5e5', '1bd9d6b3-b62b-4d78-af91-1c362b9a5c8b', '6aa1763d-bd1a-4fa5-9ca1-0deeff5fe2c8', '080619a1-702a-41e5-bb5a-1854bbb40a70'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:19 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:19 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:19 devstack sudo[106999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:28:19 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:19 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0" returned: 0 in 1.224s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:19 devstack sudo[107002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0
Jun 06 01:28:19 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:19 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e6feefb6-acbe-4662-b154-7b117f60c334" returned: 0 in 1.085s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:19 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e6feefb6-acbe-4662-b154-7b117f60c334 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:19 devstack sudo[107006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e6feefb6-acbe-4662-b154-7b117f60c334
Jun 06 01:28:19 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:20 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.740s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:20 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:28:20 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Deleted volume successfully.
Jun 06 01:28:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-7d5135df-7bb8-4506-8e3b-9a25c506ea94 tempest-VolumeAndVolumeTypeFromImageTest-425299885 None] Lock "cinder-a8581998-6187-4236-934a-7aa3d92a228f-delete_volume" released by "delete_volume" :: held 4.191s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:20 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9.33793b34-7485-4d84-a6d9-aeec740d71d0" returned: 0 in 0.788s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-quobyte-33793b34-7485-4d84-a6d9-aeec740d71d0" released by "_delete_snapshot" :: held 4.650s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-quobyte-79076649-1c84-41e5-af12-9582836415a9" released by "delete_snapshot" :: held 4.680s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:20 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] Created reservations ['6affc94c-b170-4f7b-b00d-cf4081849459', '4c1a604d-3816-4872-afe8-61c04b32282e', 'e6ec325a-5d8c-4c85-b428-6420f4cf56f8', 'c69ed7e9-628f-4c01-8505-c1b64472f91f'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:20 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] Delete snapshot completed successfully.
Jun 06 01:28:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b2f14dfd-6ccf-449d-87dd-885b87827e48 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-33793b34-7485-4d84-a6d9-aeec740d71d0-delete_snapshot" released by "delete_snapshot" :: held 4.871s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:20 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-e6feefb6-acbe-4662-b154-7b117f60c334" returned: 0 in 0.794s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:20 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-quobyte-e6feefb6-acbe-4662-b154-7b117f60c334" released by "delete_volume" :: held 1.940s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:20 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Created reservations ['35e2d6d9-e2a8-459a-938e-d4437a8acb6b', 'cae5f722-9900-4b04-a37e-57234077ae58', 'bf3e3c64-cb78-4869-98dd-4cf3579f7ffe', '09b51b53-91b5-4150-9a2a-fd38518206ad'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:20 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:20 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:20 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:20 devstack sudo[107011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:28:20 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] Acquiring lock "cinder-79076649-1c84-41e5-af12-9582836415a9-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-79076649-1c84-41e5-af12-9582836415a9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] Acquiring lock "cinder-quobyte-79076649-1c84-41e5-af12-9582836415a9" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-quobyte-79076649-1c84-41e5-af12-9582836415a9" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:21 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7135fd6-5b46-4c3d-a609-1ad22cc4d40f]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:21 devstack sudo[107013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9
Jun 06 01:28:21 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:21 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:21 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.854s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:21 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:28:21 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Deleted volume successfully.
Jun 06 01:28:21 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-cbcaa864-b993-4b6e-8bd9-50054f8db2a2 tempest-CreateVolumesFromSourceVolumeTest-859550366 None] Lock "cinder-e6feefb6-acbe-4662-b154-7b117f60c334-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:22 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9" returned: 0 in 1.004s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:22 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:22 devstack sudo[107021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9
Jun 06 01:28:22 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:23 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-79076649-1c84-41e5-af12-9582836415a9" returned: 0 in 0.682s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-quobyte-79076649-1c84-41e5-af12-9582836415a9" released by "delete_volume" :: held 1.793s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:23 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] Created reservations ['b2ae79a4-81bc-47d9-a91a-a7a2ee7e7abb', '76c5c525-9181-4f0d-b255-5cf328c5c846', 'bc812de0-1c7b-4c89-b874-d3bb72b4a111', '1ad61280-bb10-4128-a67c-4ceb231b98b3'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:23 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:23 devstack sudo[107025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:28:23 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] Acquiring lock "cinder-ad64d379-5613-4324-bb50-975ef98d1906-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-ad64d379-5613-4324-bb50-975ef98d1906-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] Acquiring lock "cinder-quobyte-ad64d379-5613-4324-bb50-975ef98d1906" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:23 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-quobyte-ad64d379-5613-4324-bb50-975ef98d1906" acquired by "delete_volume" :: waited 0.045s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:23 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[7347519f-385e-43af-8700-6893d5ae77a1]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:23 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad64d379-5613-4324-bb50-975ef98d1906 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:23 devstack sudo[107028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad64d379-5613-4324-bb50-975ef98d1906
Jun 06 01:28:23 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:24 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.883s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:24 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:28:24 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] Deleted volume successfully.
Jun 06 01:28:24 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-c6f77e23-64f8-498a-b979-9377974ae811 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-79076649-1c84-41e5-af12-9582836415a9-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:24 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad64d379-5613-4324-bb50-975ef98d1906" returned: 0 in 0.965s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:24 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad64d379-5613-4324-bb50-975ef98d1906 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:24 devstack sudo[107035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad64d379-5613-4324-bb50-975ef98d1906
Jun 06 01:28:24 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:25 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ad64d379-5613-4324-bb50-975ef98d1906" returned: 0 in 0.787s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:25 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-quobyte-ad64d379-5613-4324-bb50-975ef98d1906" released by "delete_volume" :: held 1.849s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:25 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] Created reservations ['0d456f2d-8748-464c-9024-172d0a59decb', '7f18fa64-50b8-48f0-98ca-ecd1c87fe0ab', '456c2509-eda6-4873-a2c1-49f155f9e4d6', '530ba441-251c-4c63-afb1-1adb31ab6cc1'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:25 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:25 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:25 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:25 devstack sudo[107038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:28:25 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:26 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:26 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.856s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:26 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:28:26 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] Deleted volume successfully.
Jun 06 01:28:26 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-9bc4b5b3-2325-4618-bf8d-4925a6df24a1 tempest-VolumeDependencyTests-636815276 None] Lock "cinder-ad64d379-5613-4324-bb50-975ef98d1906-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Flow 'volume_create_manager' (82343f51-4170-4ab6-abff-8b124336d399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25cbbb3c-258d-4304-a68f-077768f38728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25cbbb3c-258d-4304-a68f-077768f38728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1942496492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad32f88def424f8a957ebb098803e274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:28Z,use_quota=True,user_id='4e3a10ddcd9f4f108a8e55ab416f06d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70de7f2d-ec5c-417d-b83d-60b5e35875d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70de7f2d-ec5c-417d-b83d-60b5e35875d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca2ca4f-d116-499d-b2bf-40d5b652685f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca2ca4f-d116-499d-b2bf-40d5b652685f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0', 'volume_name': 'volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbe6a85-3cdb-4170-b8a8-dfb6debe9f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbe6a85-3cdb-4170-b8a8-dfb6debe9f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb72741-ac6b-491c-b4a7-edda718e26de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:27 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume 2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0', 'volume_size': 1}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1942496492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad32f88def424f8a957ebb098803e274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:28Z,use_quota=True,user_id='4e3a10ddcd9f4f108a8e55ab416f06d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Creating volume 2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:28:27 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:28:27 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:27 devstack sudo[107043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0 1073741824
Jun 06 01:28:27 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:28 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0 1073741824" returned: 0 in 1.083s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:28 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:28 devstack sudo[107049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0
Jun 06 01:28:28 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Flow 'volume_create_manager' (8acfdd9e-b748-4c76-8d3c-0a73ccd983b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28a5c45-e6f8-4174-b54a-9140cd408cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28a5c45-e6f8-4174-b54a-9140cd408cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d93c04-0aff-4d23-8c91-376b16b3511d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55c496122174ceda5e1f2054cc6aeea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:29Z,use_quota=True,user_id='b20cfba639d742fb8a4557518d7d0c19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6a5d20-f218-43cb-98c8-559da55dd80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6a5d20-f218-43cb-98c8-559da55dd80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431ea7ec-f272-4b74-ab3c-515d032759d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.image.glance [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Creating Keystone auth plugin from conf {{(pid=86581) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 06 01:28:29 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0" returned: 0 in 0.882s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431ea7ec-f272-4b74-ab3c-515d032759d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '32d93c04-0aff-4d23-8c91-376b16b3511d', 'volume_name': 'volume-32d93c04-0aff-4d23-8c91-376b16b3511d', 'volume_size': 1, 'image_id': '6d87d29b-5c0b-4b72-a759-b0cb58cb21fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d87d29b-5c0b-4b72-a759-b0cb58cb21fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33cc7db323099b935c68a72862cfc692', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f55c496122174ceda5e1f2054cc6aeea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6f588c906aa453f20f874a48bbceb56a9187dcd3b83d08cc7e116b976f84c1049569ee4a5471c5e048239198d87a92ff2b9e640db651a0c8ff4f153116deadbc', 'id': '6d87d29b-5c0b-4b72-a759-b0cb58cb21fd', 'created_at': datetime.datetime(2026, 6, 5, 23, 28, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 23, 28, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d87d29b-5c0b-4b72-a759-b0cb58cb21fd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2c6f050>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8eaba88-e042-46bd-8055-0480550c70cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8eaba88-e042-46bd-8055-0480550c70cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a1b5df-e5e9-48bf-8bc6-232eca8b979d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:29 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Volume 32d93c04-0aff-4d23-8c91-376b16b3511d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-32d93c04-0aff-4d23-8c91-376b16b3511d', 'volume_size': 1, 'image_id': '6d87d29b-5c0b-4b72-a759-b0cb58cb21fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d87d29b-5c0b-4b72-a759-b0cb58cb21fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33cc7db323099b935c68a72862cfc692', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f55c496122174ceda5e1f2054cc6aeea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6f588c906aa453f20f874a48bbceb56a9187dcd3b83d08cc7e116b976f84c1049569ee4a5471c5e048239198d87a92ff2b9e640db651a0c8ff4f153116deadbc', 'id': '6d87d29b-5c0b-4b72-a759-b0cb58cb21fd', 'created_at': datetime.datetime(2026, 6, 5, 23, 28, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 23, 28, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d87d29b-5c0b-4b72-a759-b0cb58cb21fd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2c6f050>}
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Trying to clone 32d93c04-0aff-4d23-8c91-376b16b3511d from image 6d87d29b-5c0b-4b72-a759-b0cb58cb21fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/6d87d29b-5c0b-4b72-a759-b0cb58cb21fd', 'metadata': {}}]). {{(pid=86581) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb72741-ac6b-491c-b4a7-edda718e26de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7005ac2-4ec7-4b36-a81b-ab29fe245420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:29 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0 (2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0): created successfully
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7005ac2-4ec7-4b36-a81b-ab29fe245420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Flow 'volume_create_manager' (82343f51-4170-4ab6-abff-8b124336d399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:29 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-4c48f90d-eb86-41be-ad0d-4ba4e7f42f66 tempest-CreateVolumesFromSnapshotTest-473469400 None] Created volume successfully.
Jun 06 01:28:29 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jun 06 01:28:29 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Image download 0.00 MB at 0.00 MB/s
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85d4b31-de84-434b-8507-af168798e703]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:30 devstack sudo[107052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD
Jun 06 01:28:30 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Flow 'volume_create_manager' (d440bbd1-385a-4004-b703-344dcb576b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502c82da-b533-4eeb-8283-a05e9e6ab12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502c82da-b533-4eeb-8283-a05e9e6ab12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b681590f-2eb2-40e3-a6ce-61a7e96fc608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d556e97d194a2b9c62635708297069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:30Z,use_quota=True,user_id='0345d4c997414afbb26b9402fcc66dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf856792-977e-4423-97b5-048276f8925b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf856792-977e-4423-97b5-048276f8925b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c30e425-33b6-4110-b745-796a76a09429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c30e425-33b6-4110-b745-796a76a09429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b681590f-2eb2-40e3-a6ce-61a7e96fc608', 'volume_name': 'volume-b681590f-2eb2-40e3-a6ce-61a7e96fc608', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06c197e-226f-479c-9fbd-d5dd26ed5df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06c197e-226f-479c-9fbd-d5dd26ed5df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc41f979-7124-48cf-aa63-518e454f0d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:30 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Volume b681590f-2eb2-40e3-a6ce-61a7e96fc608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b681590f-2eb2-40e3-a6ce-61a7e96fc608', 'volume_size': 1}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b681590f-2eb2-40e3-a6ce-61a7e96fc608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d556e97d194a2b9c62635708297069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:30Z,use_quota=True,user_id='0345d4c997414afbb26b9402fcc66dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Creating volume b681590f-2eb2-40e3-a6ce-61a7e96fc608 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:28:30 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b681590f-2eb2-40e3-a6ce-61a7e96fc608 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:30 devstack sudo[107054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b681590f-2eb2-40e3-a6ce-61a7e96fc608 1073741824
Jun 06 01:28:30 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:30 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:30 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:30 devstack sudo[107058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD
Jun 06 01:28:30 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:31 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b681590f-2eb2-40e3-a6ce-61a7e96fc608 1073741824" returned: 0 in 0.926s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b681590f-2eb2-40e3-a6ce-61a7e96fc608 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:31 devstack sudo[107064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b681590f-2eb2-40e3-a6ce-61a7e96fc608
Jun 06 01:28:31 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:31 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD" returned: 1 in 0.770s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:28:31 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Temporary image 6d87d29b-5c0b-4b72-a759-b0cb58cb21fd is fetched for user b20cfba639d742fb8a4557518d7d0c19. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jun 06 01:28:31 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc15524-9132-4c84-b915-874704f917c1]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:31 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:31 devstack sudo[107069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD
Jun 06 01:28:31 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:32 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b681590f-2eb2-40e3-a6ce-61a7e96fc608" returned: 0 in 0.617s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:28:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.880s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:32 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] Creating offline snapshot 9dedb5ce-e2d7-4588-afe2-8eea5ea570ac of volume 2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:28:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc41f979-7124-48cf-aa63-518e454f0d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b681590f-2eb2-40e3-a6ce-61a7e96fc608', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf54b59-d906-4fc5-85a2-9374840e13cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:32 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[535c69cb-167d-459d-8611-57358c74d32e]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:32 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Volume volume-b681590f-2eb2-40e3-a6ce-61a7e96fc608 (b681590f-2eb2-40e3-a6ce-61a7e96fc608): created successfully
Jun 06 01:28:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf54b59-d906-4fc5-85a2-9374840e13cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:32 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Flow 'volume_create_manager' (d440bbd1-385a-4004-b703-344dcb576b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:32 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-aea9c03a-419e-409a-a16f-2ef7c79fad9f tempest-CinderUnicodeTest-1119506108 None] Created volume successfully.
Jun 06 01:28:32 devstack sudo[107072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0
Jun 06 01:28:32 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:32 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD" returned: 0 in 0.957s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:32 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:32 devstack sudo[107076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD
Jun 06 01:28:32 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:33 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0" returned: 0 in 0.976s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:33 devstack sudo[107082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac 1G
Jun 06 01:28:33 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:33 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:28:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Flow 'volume_create_manager' (cf8580a7-8965-4b25-b2aa-56d6dc7046a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bea723-ca90-4d34-b90b-58d84516842e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bea723-ca90-4d34-b90b-58d84516842e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1149171779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbff6a20-a684-4c6a-9bdb-34d73e823520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d556e97d194a2b9c62635708297069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:33Z,use_quota=True,user_id='0345d4c997414afbb26b9402fcc66dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780a278e-7690-441e-a15b-3bf9c4330158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780a278e-7690-441e-a15b-3bf9c4330158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36eeef50-dabf-4033-b5c0-f45e5723945c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36eeef50-dabf-4033-b5c0-f45e5723945c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbff6a20-a684-4c6a-9bdb-34d73e823520', 'volume_name': 'volume-dbff6a20-a684-4c6a-9bdb-34d73e823520', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1eacf4-59aa-4ba4-badd-056c5c75ac6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1eacf4-59aa-4ba4-badd-056c5c75ac6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:33 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fed15b2-6bbf-4337-9fc9-28a9273a52c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:33 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Volume dbff6a20-a684-4c6a-9bdb-34d73e823520: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbff6a20-a684-4c6a-9bdb-34d73e823520', 'volume_size': 1}
Jun 06 01:28:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:33 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD" returned: 1 in 0.826s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:28:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:34 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac 1G" returned: 0 in 1.024s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:34 devstack sudo[107092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac
Jun 06 01:28:34 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:34 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac" returned: 0 in 0.706s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:34 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac is being set with open permissions: ugo+rw
Jun 06 01:28:34 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:34 devstack sudo[107097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac
Jun 06 01:28:34 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:35 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac" returned: 0 in 0.623s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:35 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:35 devstack sudo[107100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.info
Jun 06 01:28:35 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:36 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.info" returned: 0 in 0.653s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:36 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.info is being set with open permissions: ugo+rw
Jun 06 01:28:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:36 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.info
Jun 06 01:28:36 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:36 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.info" returned: 0 in 0.614s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.753s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.467s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:36 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1149171779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbff6a20-a684-4c6a-9bdb-34d73e823520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d556e97d194a2b9c62635708297069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:33Z,use_quota=True,user_id='0345d4c997414afbb26b9402fcc66dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:28:36 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Creating volume dbff6a20-a684-4c6a-9bdb-34d73e823520 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:28:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:36 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:36 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:36 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:28:36 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:28:36 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:36 devstack sudo[107106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520 1073741824
Jun 06 01:28:36 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:36 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-628e1b0c-422b-4aab-8ebf-315485a8b273 tempest-CreateVolumesFromSnapshotTest-473469400 None] Create snapshot completed successfully
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Flow 'volume_create_manager' (604b2f48-7cfb-424f-882c-f9e1d8c8a361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a5f5eb-c0b4-471c-bac2-a7fed3c1b74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a5f5eb-c0b4-471c-bac2-a7fed3c1b74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1946571004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c1537b-37b3-41e0-9623-0d89428318c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b6bc84da6f3471595e67953a90084c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:37Z,use_quota=True,user_id='307ff226ded34157b3e310dea48e2849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d6ef60-5855-481b-90c1-2f415371e22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d6ef60-5855-481b-90c1-2f415371e22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a64566-5d27-4430-b065-81ef24c80762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a64566-5d27-4430-b065-81ef24c80762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33c1537b-37b3-41e0-9623-0d89428318c4', 'volume_name': 'volume-33c1537b-37b3-41e0-9623-0d89428318c4', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057d442a-bfe3-4231-99e0-20c9095c62da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057d442a-bfe3-4231-99e0-20c9095c62da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5ee4fb-102f-4af3-a507-1b900bb0734b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:37 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Volume 33c1537b-37b3-41e0-9623-0d89428318c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33c1537b-37b3-41e0-9623-0d89428318c4', 'volume_size': 1}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:37 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520 1073741824" returned: 0 in 0.819s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:37 devstack sudo[107112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520
Jun 06 01:28:37 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Flow 'volume_create_manager' (9ddde7a4-b615-457d-9c51-3ca4bd5737ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ee7881-dadd-4ec2-bd48-c9b3435ddb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ee7881-dadd-4ec2-bd48-c9b3435ddb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1557686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdb3977-26c2-4833-bc71-d57b7cea2d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad32f88def424f8a957ebb098803e274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:38Z,use_quota=True,user_id='4e3a10ddcd9f4f108a8e55ab416f06d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2839dbcd-6376-41bd-af20-099d2791adf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2839dbcd-6376-41bd-af20-099d2791adf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f55ef2-102b-4710-8446-cc1a4ca4d4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f55ef2-102b-4710-8446-cc1a4ca4d4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcdb3977-26c2-4833-bc71-d57b7cea2d56', 'volume_name': 'volume-bcdb3977-26c2-4833-bc71-d57b7cea2d56', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b73d31e-eeeb-4dc8-a6b4-84af2a47ceaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b73d31e-eeeb-4dc8-a6b4-84af2a47ceaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7c6cc3-9e50-4fc0-bbab-cc3ec508b6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:37 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume bcdb3977-26c2-4833-bc71-d57b7cea2d56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcdb3977-26c2-4833-bc71-d57b7cea2d56', 'volume_size': 1}
Jun 06 01:28:37 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:UPDATE=177,cinder:SELECT=119,cinder:INSERT=44,cinder:DELETE=18 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Flow 'volume_create_manager' (e9d677ac-71da-4b73-b8d6-f28c46b09d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b7604c-9bf8-4f9a-b549-63a3b6fe0ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:38 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520" returned: 0 in 0.640s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.879s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d93c04-0aff-4d23-8c91-376b16b3511d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55c496122174ceda5e1f2054cc6aeea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:29Z,use_quota=True,user_id='b20cfba639d742fb8a4557518d7d0c19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Creating volume 32d93c04-0aff-4d23-8c91-376b16b3511d {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:28:38 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b7604c-9bf8-4f9a-b549-63a3b6fe0ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2057821488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731cf63b-0c5c-4405-9691-04d908d20e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad32f88def424f8a957ebb098803e274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:38Z,use_quota=True,user_id='4e3a10ddcd9f4f108a8e55ab416f06d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c21708-fb24-461d-b8b0-d19ce4cb2c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c21708-fb24-461d-b8b0-d19ce4cb2c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:38 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d 1073741824
Jun 06 01:28:38 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb7508f-1d00-48d0-a3fb-baf99ea8ab08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb7508f-1d00-48d0-a3fb-baf99ea8ab08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '731cf63b-0c5c-4405-9691-04d908d20e2e', 'volume_name': 'volume-731cf63b-0c5c-4405-9691-04d908d20e2e', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f470ea6-9ca7-4c15-89e8-ed306663aac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f470ea6-9ca7-4c15-89e8-ed306663aac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675ddd18-832d-4abb-a303-c088c2899bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:38 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume 731cf63b-0c5c-4405-9691-04d908d20e2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-731cf63b-0c5c-4405-9691-04d908d20e2e', 'volume_size': 1}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fed15b2-6bbf-4337-9fc9-28a9273a52c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbff6a20-a684-4c6a-9bdb-34d73e823520', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b61990-d3a5-4cff-a89a-d39d295fc045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:38 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Volume volume-dbff6a20-a684-4c6a-9bdb-34d73e823520 (dbff6a20-a684-4c6a-9bdb-34d73e823520): created successfully
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b61990-d3a5-4cff-a89a-d39d295fc045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Flow 'volume_create_manager' (cf8580a7-8965-4b25-b2aa-56d6dc7046a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:38 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-9919bf9d-b9d7-4028-931f-82d65e11023b tempest-CinderUnicodeTest-1119506108 None] Created volume successfully.
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Flow 'volume_create_manager' (91ce9477-4a7d-45f3-925c-d6b2e2b37988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bd2c31-4744-42e9-a818-ca5f63a62ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bd2c31-4744-42e9-a818-ca5f63a62ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-333208868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3be240-c095-45bc-9533-de06c06f4281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad32f88def424f8a957ebb098803e274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:39Z,use_quota=True,user_id='4e3a10ddcd9f4f108a8e55ab416f06d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23baf2cc-12e0-4d04-9161-4d8a77db7d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23baf2cc-12e0-4d04-9161-4d8a77db7d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1da4353-2ecd-4ee7-bcf6-5828e7afc45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1da4353-2ecd-4ee7-bcf6-5828e7afc45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb3be240-c095-45bc-9533-de06c06f4281', 'volume_name': 'volume-eb3be240-c095-45bc-9533-de06c06f4281', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d172b8-fa9d-4b45-8703-71a0830da524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d172b8-fa9d-4b45-8703-71a0830da524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c260f9-af45-48b0-a779-25a2cc5c378a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:38 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume eb3be240-c095-45bc-9533-de06c06f4281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb3be240-c095-45bc-9533-de06c06f4281', 'volume_size': 1}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=138,cinder:UPDATE=171,cinder:DELETE=14,cinder:INSERT=45 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Flow 'volume_create_manager' (4ceaef46-4ff6-4b6c-8aad-63b00dfdcce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1392776b-c599-4998-abf1-3e49157e7240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1392776b-c599-4998-abf1-3e49157e7240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-77398993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad32f88def424f8a957ebb098803e274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:39Z,use_quota=True,user_id='4e3a10ddcd9f4f108a8e55ab416f06d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55cf61e3-b689-42d1-8990-5634e45a141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55cf61e3-b689-42d1-8990-5634e45a141d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5de91ef-8498-48bc-bb44-1a18ed361d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5de91ef-8498-48bc-bb44-1a18ed361d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd', 'volume_name': 'volume-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55d7db1-1fc8-4cac-bde7-1ef1997d0c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55d7db1-1fc8-4cac-bde7-1ef1997d0c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef5024b8-3438-4d49-a34f-997fa235e61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:38 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume 78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd', 'volume_size': 1}
Jun 06 01:28:38 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:39 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d 1073741824" returned: 0 in 0.916s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:28:39 devstack sudo[107121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d
Jun 06 01:28:39 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Flow 'volume_create_manager' (bcf73a88-55b1-48bc-b13e-c61164f4e842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea3949d-12ee-4c92-a50f-91404df5fbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea3949d-12ee-4c92-a50f-91404df5fbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1374489943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae80fbd5-998e-4e5e-8b70-f255299d0177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad32f88def424f8a957ebb098803e274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:39Z,use_quota=True,user_id='4e3a10ddcd9f4f108a8e55ab416f06d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421bebd5-5f0e-464a-a728-ac6fecd4bb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421bebd5-5f0e-464a-a728-ac6fecd4bb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821f3a04-4431-4fd1-8aff-8b2a7d1322db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821f3a04-4431-4fd1-8aff-8b2a7d1322db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae80fbd5-998e-4e5e-8b70-f255299d0177', 'volume_name': 'volume-ae80fbd5-998e-4e5e-8b70-f255299d0177', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8620b24b-38c6-4a57-8157-653815bcb531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8620b24b-38c6-4a57-8157-653815bcb531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5772627d-2c6f-4fa8-91c0-ae6ec4b942ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:39 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume ae80fbd5-998e-4e5e-8b70-f255299d0177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae80fbd5-998e-4e5e-8b70-f255299d0177', 'volume_size': 1}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:39 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d" returned: 0 in 0.609s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.597s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1946571004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c1537b-37b3-41e0-9623-0d89428318c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b6bc84da6f3471595e67953a90084c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:37Z,use_quota=True,user_id='307ff226ded34157b3e310dea48e2849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Creating volume 33c1537b-37b3-41e0-9623-0d89428318c4 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:28:39 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:28:39 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:39 devstack sudo[107124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4 1073741824
Jun 06 01:28:39 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:40 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Attempting download of 6d87d29b-5c0b-4b72-a759-b0cb58cb21fd ((None, [{'url': 'file:///opt/stack/data/glance/images/6d87d29b-5c0b-4b72-a759-b0cb58cb21fd', 'metadata': {}}])) to volume 32d93c04-0aff-4d23-8c91-376b16b3511d. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jun 06 01:28:40 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[9166e14f-d242-46a5-987d-b4ca56972919]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rf2nga_a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:40 devstack sudo[107126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rf2nga_a
Jun 06 01:28:40 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:40 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4 1073741824" returned: 0 in 0.840s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:40 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rf2nga_a" returned: 0 in 0.695s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rf2nga_a {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:40 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:40 devstack sudo[107134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4
Jun 06 01:28:40 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:40 devstack sudo[107133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rf2nga_a
Jun 06 01:28:40 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:41 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4" returned: 0 in 0.605s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.477s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1557686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdb3977-26c2-4833-bc71-d57b7cea2d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad32f88def424f8a957ebb098803e274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:38Z,use_quota=True,user_id='4e3a10ddcd9f4f108a8e55ab416f06d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Creating volume bcdb3977-26c2-4833-bc71-d57b7cea2d56 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:28:41 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bcdb3977-26c2-4833-bc71-d57b7cea2d56 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:41 devstack sudo[107140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bcdb3977-26c2-4833-bc71-d57b7cea2d56 1073741824
Jun 06 01:28:41 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5ee4fb-102f-4af3-a507-1b900bb0734b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33c1537b-37b3-41e0-9623-0d89428318c4', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41286a6b-5750-4347-8426-837555c373bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:41 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Volume volume-33c1537b-37b3-41e0-9623-0d89428318c4 (33c1537b-37b3-41e0-9623-0d89428318c4): created successfully
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41286a6b-5750-4347-8426-837555c373bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Flow 'volume_create_manager' (604b2f48-7cfb-424f-882c-f9e1d8c8a361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:41 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rf2nga_a" returned: 1 in 0.719s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rf2nga_a' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[313a4425-8ed7-4864-a883-0bb2c528042c]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:41 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:41 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-6dbbf65f-33f0-47ef-a0cc-26c2c52acac8 tempest-SnapshotDependencyTests-845204522 None] Created volume successfully.
Jun 06 01:28:41 devstack sudo[107142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD
Jun 06 01:28:41 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:42 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD" returned: 0 in 0.687s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:42 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bcdb3977-26c2-4833-bc71-d57b7cea2d56 1073741824" returned: 0 in 0.786s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bcdb3977-26c2-4833-bc71-d57b7cea2d56 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:42 devstack sudo[107151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bcdb3977-26c2-4833-bc71-d57b7cea2d56
Jun 06 01:28:42 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:42 devstack sudo[107150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD
Jun 06 01:28:42 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:42 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:42 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bcdb3977-26c2-4833-bc71-d57b7cea2d56" returned: 0 in 0.708s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.587s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2057821488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731cf63b-0c5c-4405-9691-04d908d20e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad32f88def424f8a957ebb098803e274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:38Z,use_quota=True,user_id='4e3a10ddcd9f4f108a8e55ab416f06d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Creating volume 731cf63b-0c5c-4405-9691-04d908d20e2e {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:28:42 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-731cf63b-0c5c-4405-9691-04d908d20e2e 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD" returned: 1 in 0.790s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] 6d87d29b-5c0b-4b72-a759-b0cb58cb21fd was raw, converting to raw {{(pid=86581) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jun 06 01:28:42 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:42 devstack sudo[107158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-731cf63b-0c5c-4405-9691-04d908d20e2e 1073741824
Jun 06 01:28:42 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7c6cc3-9e50-4fc0-bbab-cc3ec508b6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcdb3977-26c2-4833-bc71-d57b7cea2d56', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a825b7-465d-41f5-85b7-6068de336df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:43 devstack sudo[107160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d
Jun 06 01:28:43 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:43 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume volume-bcdb3977-26c2-4833-bc71-d57b7cea2d56 (bcdb3977-26c2-4833-bc71-d57b7cea2d56): created successfully
Jun 06 01:28:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a825b7-465d-41f5-85b7-6068de336df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:43 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Flow 'volume_create_manager' (9ddde7a4-b615-457d-9c51-3ca4bd5737ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:43 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-bbb3e7e7-e0c5-4bd7-aaf9-9c9cd32724a9 tempest-CreateVolumesFromSnapshotTest-473469400 None] Created volume successfully.
Jun 06 01:28:43 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d" returned: 0 in 0.698s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:43 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6d87d29b-5c0b-4b72-a759-b0cb58cb21fd_rwyvk30adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:28:43 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Converted 0.00 MB image at 0.00 MB/s
Jun 06 01:28:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:43 devstack sudo[107170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d 1G
Jun 06 01:28:43 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:43 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-731cf63b-0c5c-4405-9691-04d908d20e2e 1073741824" returned: 0 in 0.839s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:43 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-731cf63b-0c5c-4405-9691-04d908d20e2e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:43 devstack sudo[107172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-731cf63b-0c5c-4405-9691-04d908d20e2e
Jun 06 01:28:43 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:44 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d 1G" returned: 0 in 0.660s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a2324a-25fd-444f-b990-f4d21aa19d55]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:44 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-731cf63b-0c5c-4405-9691-04d908d20e2e" returned: 0 in 0.612s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.780s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-333208868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3be240-c095-45bc-9533-de06c06f4281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad32f88def424f8a957ebb098803e274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:39Z,use_quota=True,user_id='4e3a10ddcd9f4f108a8e55ab416f06d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Creating volume eb3be240-c095-45bc-9533-de06c06f4281 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:28:44 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-eb3be240-c095-45bc-9533-de06c06f4281 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675ddd18-832d-4abb-a303-c088c2899bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-731cf63b-0c5c-4405-9691-04d908d20e2e', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:44 devstack sudo[107178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d
Jun 06 01:28:44 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:44 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-eb3be240-c095-45bc-9533-de06c06f4281 1073741824
Jun 06 01:28:44 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b48a647-d14f-4a44-acdb-e2319c90ac94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:44 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume volume-731cf63b-0c5c-4405-9691-04d908d20e2e (731cf63b-0c5c-4405-9691-04d908d20e2e): created successfully
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b48a647-d14f-4a44-acdb-e2319c90ac94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:44 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Flow 'volume_create_manager' (e9d677ac-71da-4b73-b8d6-f28c46b09d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:44 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-3e48bded-d0d0-456a-baaa-27966a2014b0 tempest-CreateVolumesFromSnapshotTest-473469400 None] Created volume successfully.
Jun 06 01:28:45 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d" returned: 0 in 0.745s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:45 devstack sudo[107188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d
Jun 06 01:28:45 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:45 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-eb3be240-c095-45bc-9533-de06c06f4281 1073741824" returned: 0 in 0.788s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-eb3be240-c095-45bc-9533-de06c06f4281 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:45 devstack sudo[107190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-eb3be240-c095-45bc-9533-de06c06f4281
Jun 06 01:28:45 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:45 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d" returned: 1 in 0.728s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Downloaded image 6d87d29b-5c0b-4b72-a759-b0cb58cb21fd ((None, [{'url': 'file:///opt/stack/data/glance/images/6d87d29b-5c0b-4b72-a759-b0cb58cb21fd', 'metadata': {}}])) to volume 32d93c04-0aff-4d23-8c91-376b16b3511d successfully. {{(pid=86581) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Temporary image 6d87d29b-5c0b-4b72-a759-b0cb58cb21fd for user b20cfba639d742fb8a4557518d7d0c19 is deleted. {{(pid=86581) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG cinder.volume.volume_utils [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Marking volume 32d93c04-0aff-4d23-8c91-376b16b3511d as bootable. {{(pid=86581) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Copying metadata from image 6d87d29b-5c0b-4b72-a759-b0cb58cb21fd to 32d93c04-0aff-4d23-8c91-376b16b3511d. {{(pid=86581) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Creating volume glance metadata for volume 32d93c04-0aff-4d23-8c91-376b16b3511d backed by image 6d87d29b-5c0b-4b72-a759-b0cb58cb21fd with: {'image_id': '6d87d29b-5c0b-4b72-a759-b0cb58cb21fd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '33cc7db323099b935c68a72862cfc692', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86581) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 06 01:28:45 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-eb3be240-c095-45bc-9533-de06c06f4281" returned: 0 in 0.648s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.947s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-77398993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad32f88def424f8a957ebb098803e274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:39Z,use_quota=True,user_id='4e3a10ddcd9f4f108a8e55ab416f06d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Creating volume 78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:28:45 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a1b5df-e5e9-48bf-8bc6-232eca8b979d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d93c04-0aff-4d23-8c91-376b16b3511d', 'volume_size': 1, 'image_id': '6d87d29b-5c0b-4b72-a759-b0cb58cb21fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d87d29b-5c0b-4b72-a759-b0cb58cb21fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33cc7db323099b935c68a72862cfc692', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f55c496122174ceda5e1f2054cc6aeea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6f588c906aa453f20f874a48bbceb56a9187dcd3b83d08cc7e116b976f84c1049569ee4a5471c5e048239198d87a92ff2b9e640db651a0c8ff4f153116deadbc', 'id': '6d87d29b-5c0b-4b72-a759-b0cb58cb21fd', 'created_at': datetime.datetime(2026, 6, 5, 23, 28, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 5, 23, 28, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d87d29b-5c0b-4b72-a759-b0cb58cb21fd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7926a2c6f050>}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7423aa-4bd3-44d2-afc5-12cd9a2ad1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:45 devstack sudo[107196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd 1073741824
Jun 06 01:28:45 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:45 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c260f9-af45-48b0-a779-25a2cc5c378a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb3be240-c095-45bc-9533-de06c06f4281', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ebeda17-f2e9-411a-a7f2-c39f881703ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:46 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Volume volume-32d93c04-0aff-4d23-8c91-376b16b3511d (32d93c04-0aff-4d23-8c91-376b16b3511d): created successfully
Jun 06 01:28:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7423aa-4bd3-44d2-afc5-12cd9a2ad1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Flow 'volume_create_manager' (8acfdd9e-b748-4c76-8d3c-0a73ccd983b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:46 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-bf1730ac-2524-40f5-8c5c-c4a0c07c47ff tempest-VolumeImageDependencyTests-947274119 None] Created volume successfully.
Jun 06 01:28:46 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume volume-eb3be240-c095-45bc-9533-de06c06f4281 (eb3be240-c095-45bc-9533-de06c06f4281): created successfully
Jun 06 01:28:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ebeda17-f2e9-411a-a7f2-c39f881703ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:46 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Flow 'volume_create_manager' (91ce9477-4a7d-45f3-925c-d6b2e2b37988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:46 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-c48006a1-88d0-472c-96c7-122b47abd668 tempest-CreateVolumesFromSnapshotTest-473469400 None] Created volume successfully.
Jun 06 01:28:46 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd 1073741824" returned: 0 in 0.804s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:46 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:46 devstack sudo[107201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd
Jun 06 01:28:46 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Acquiring lock "cinder-32d93c04-0aff-4d23-8c91-376b16b3511d-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Lock "cinder-32d93c04-0aff-4d23-8c91-376b16b3511d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Acquiring lock "cinder-quobyte-32d93c04-0aff-4d23-8c91-376b16b3511d" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:46 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Lock "cinder-quobyte-32d93c04-0aff-4d23-8c91-376b16b3511d" acquired by "delete_volume" :: waited 0.020s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[026b16db-c803-4f29-b532-da6b71955fd4]: (4, 'raw') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:47 devstack sudo[107203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d
Jun 06 01:28:47 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:47 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd" returned: 0 in 0.625s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.015s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7926a3762b70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1374489943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae80fbd5-998e-4e5e-8b70-f255299d0177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad32f88def424f8a957ebb098803e274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:39Z,use_quota=True,user_id='4e3a10ddcd9f4f108a8e55ab416f06d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)}" {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Creating volume ae80fbd5-998e-4e5e-8b70-f255299d0177 {{(pid=86581) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:28:47 devstack cinder-volume[86581]: INFO cinder.volume.drivers.remotefs [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] casted to osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ae80fbd5-998e-4e5e-8b70-f255299d0177 1073741824 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef5024b8-3438-4d49-a34f-997fa235e61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:47 devstack sudo[107206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ae80fbd5-998e-4e5e-8b70-f255299d0177 1073741824
Jun 06 01:28:47 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27451675-4270-463f-b2a1-f045d4e974a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:47 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume volume-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd (78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd): created successfully
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27451675-4270-463f-b2a1-f045d4e974a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Flow 'volume_create_manager' (4ceaef46-4ff6-4b6c-8aad-63b00dfdcce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:47 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-eebd4dbb-2fc7-469c-9793-b025e4cc07ec tempest-CreateVolumesFromSnapshotTest-473469400 None] Created volume successfully.
Jun 06 01:28:47 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d" returned: 0 in 0.703s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:47 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:47 devstack sudo[107210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d
Jun 06 01:28:47 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:48 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ae80fbd5-998e-4e5e-8b70-f255299d0177 1073741824" returned: 0 in 0.803s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ae80fbd5-998e-4e5e-8b70-f255299d0177 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:48 devstack sudo[107215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ae80fbd5-998e-4e5e-8b70-f255299d0177
Jun 06 01:28:48 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:48 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d" returned: 1 in 0.718s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d' failed. Not Retrying. {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 06 01:28:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:48 devstack sudo[107220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d
Jun 06 01:28:48 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:48 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ae80fbd5-998e-4e5e-8b70-f255299d0177" returned: 0 in 0.619s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'} {{(pid=86581) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jun 06 01:28:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.163s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:48 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] Creating offline snapshot 1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf of volume dbff6a20-a684-4c6a-9bdb-34d73e823520 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:28:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5772627d-2c6f-4fa8-91c0-ae6ec4b942ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae80fbd5-998e-4e5e-8b70-f255299d0177', 'volume_size': 1}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac7ca209-819a-4f7e-bd45-b729361d481a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:48 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9f118a-2f86-445b-b4d2-239cea709ff8]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:48 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:48 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Volume volume-ae80fbd5-998e-4e5e-8b70-f255299d0177 (ae80fbd5-998e-4e5e-8b70-f255299d0177): created successfully
Jun 06 01:28:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac7ca209-819a-4f7e-bd45-b729361d481a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:48 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Flow 'volume_create_manager' (bcf73a88-55b1-48bc-b13e-c61164f4e842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:48 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-9bddf4ad-557a-49c0-b96f-357b0a78c546 tempest-CreateVolumesFromSnapshotTest-473469400 None] Created volume successfully.
Jun 06 01:28:49 devstack sudo[107223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520
Jun 06 01:28:49 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:49 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-32d93c04-0aff-4d23-8c91-376b16b3511d" returned: 0 in 0.593s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Lock "cinder-quobyte-32d93c04-0aff-4d23-8c91-376b16b3511d" released by "delete_volume" :: held 2.096s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "cinder-ae80fbd5-998e-4e5e-8b70-f255299d0177-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Created reservations ['8ac660ed-4945-4321-8dca-17db192e564f', '41af2895-aa53-4602-a968-4d196eabf7b9', 'f0c7721f-8894-4e9b-a527-91b723abe0ee', '49531565-712c-4a1a-a7ad-319cfd855743'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-ae80fbd5-998e-4e5e-8b70-f255299d0177-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "cinder-quobyte-ae80fbd5-998e-4e5e-8b70-f255299d0177" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-quobyte-ae80fbd5-998e-4e5e-8b70-f255299d0177" acquired by "delete_volume" :: waited 0.029s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f36bed5-db8c-4678-b29e-d5d0ebab38ba]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ae80fbd5-998e-4e5e-8b70-f255299d0177 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:49 devstack sudo[107226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:28:49 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:49 devstack sudo[107227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ae80fbd5-998e-4e5e-8b70-f255299d0177
Jun 06 01:28:49 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:49 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520" returned: 0 in 0.818s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:49 devstack sudo[107234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf 1G
Jun 06 01:28:49 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:49 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.636s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:28:49 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Deleted volume successfully.
Jun 06 01:28:49 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bc24aa2d-5526-48c6-bd78-619c74d38ca0 tempest-VolumeImageDependencyTests-947274119 None] Lock "cinder-32d93c04-0aff-4d23-8c91-376b16b3511d-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:50 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ae80fbd5-998e-4e5e-8b70-f255299d0177" returned: 0 in 0.775s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ae80fbd5-998e-4e5e-8b70-f255299d0177 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:50 devstack sudo[107240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ae80fbd5-998e-4e5e-8b70-f255299d0177
Jun 06 01:28:50 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:50 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf 1G" returned: 0 in 0.873s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbff6a20-a684-4c6a-9bdb-34d73e823520 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:50 devstack sudo[107245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbff6a20-a684-4c6a-9bdb-34d73e823520 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf
Jun 06 01:28:50 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:50 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-ae80fbd5-998e-4e5e-8b70-f255299d0177" returned: 0 in 0.726s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:50 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-quobyte-ae80fbd5-998e-4e5e-8b70-f255299d0177" released by "delete_volume" :: held 1.570s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:50 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] Created reservations ['e4294677-c768-43f2-9004-fb208aff7366', '92804cb7-1fc9-4008-93b5-1968e780d24e', 'd275a3cb-454a-4a32-a32e-e028f48a0215', '1847ab7b-5e7f-4ac9-8a14-1bb538692435'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:50 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:50 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:50 devstack sudo[107248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:28:50 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:51 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbff6a20-a684-4c6a-9bdb-34d73e823520 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf" returned: 0 in 0.661s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:51 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf is being set with open permissions: ugo+rw
Jun 06 01:28:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:51 devstack sudo[107253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf
Jun 06 01:28:51 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "cinder-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "cinder-quobyte-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-quobyte-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd" acquired by "delete_volume" :: waited 0.027s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:51 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c41f50-6183-4d43-b6af-59f7086b666b]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:51 devstack sudo[107255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd
Jun 06 01:28:51 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:51 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:51 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.779s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:51 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:28:51 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] Deleted volume successfully.
Jun 06 01:28:51 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-642c3015-27bb-4e4e-8c69-801116c413d5 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-ae80fbd5-998e-4e5e-8b70-f255299d0177-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:52 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf" returned: 0 in 0.769s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:52 devstack sudo[107259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.info
Jun 06 01:28:52 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:52 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd" returned: 0 in 0.820s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:52 devstack sudo[107264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd
Jun 06 01:28:52 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:52 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.info" returned: 0 in 0.641s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:52 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.info is being set with open permissions: ugo+rw
Jun 06 01:28:52 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:52 devstack sudo[107267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.info
Jun 06 01:28:52 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:53 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd" returned: 0 in 0.628s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-quobyte-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd" released by "delete_volume" :: held 1.492s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] Created reservations ['5eca270e-90ec-42e3-86df-80d6fbfd191a', '75e2e6c0-a2dd-4f12-84cf-5dc57c31a76d', '51d6df84-9af9-4cef-a12e-a7e6351180a2', '53784eee-e81c-4616-b462-a13c3c653df0'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:53 devstack sudo[107270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:28:53 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:53 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.info" returned: 0 in 0.615s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.477s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.431s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] Creating offline snapshot 304e90b0-fb80-4917-8d6e-65f0174d6d14 of volume 33c1537b-37b3-41e0-9623-0d89428318c4 {{(pid=86581) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Jun 06 01:28:53 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-250ed4f2-0209-4765-af81-1fc4b0505ec9 tempest-CinderUnicodeTest-1119506108 None] Create snapshot completed successfully
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca69c9a-2755-449d-9e00-6a04ecd93b1b]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:53 devstack sudo[107274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4
Jun 06 01:28:53 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "cinder-eb3be240-c095-45bc-9533-de06c06f4281-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-eb3be240-c095-45bc-9533-de06c06f4281-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "cinder-quobyte-eb3be240-c095-45bc-9533-de06c06f4281" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-quobyte-eb3be240-c095-45bc-9533-de06c06f4281" acquired by "delete_volume" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:53 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[9055ff5c-c17c-458a-8ee0-86766e5660f7]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-eb3be240-c095-45bc-9533-de06c06f4281 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.684s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:28:53 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] Deleted volume successfully.
Jun 06 01:28:53 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-8f46dfba-8530-443a-9836-fc412047e199 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-78cac9ef-2e8c-4b29-b863-2f3e6cc1b2fd-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:53 devstack sudo[107277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-eb3be240-c095-45bc-9533-de06c06f4281
Jun 06 01:28:53 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:54 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4" returned: 0 in 0.719s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14 1G {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:54 devstack sudo[107282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14 1G
Jun 06 01:28:54 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] Acquiring lock "cinder-1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] Lock "cinder-1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] Acquiring lock "cinder-quobyte-dbff6a20-a684-4c6a-9bdb-34d73e823520" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] Lock "cinder-quobyte-dbff6a20-a684-4c6a-9bdb-34d73e823520" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] Acquiring lock "cinder-quobyte-1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:54 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] Lock "cinder-quobyte-1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] Deleting offline snapshot 1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf of volume dbff6a20-a684-4c6a-9bdb-34d73e823520 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:28:54 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] snapshot_file for this snap is: volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:28:54 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[362331cd-682d-4c10-8bc6-38f0acf7ff81]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:54 devstack sudo[107284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf
Jun 06 01:28:54 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:54 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-eb3be240-c095-45bc-9533-de06c06f4281" returned: 0 in 0.741s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-eb3be240-c095-45bc-9533-de06c06f4281 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:54 devstack sudo[107289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-eb3be240-c095-45bc-9533-de06c06f4281
Jun 06 01:28:54 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:54 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14 1G" returned: 0 in 0.800s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:54 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33c1537b-37b3-41e0-9623-0d89428318c4 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:54 devstack sudo[107295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33c1537b-37b3-41e0-9623-0d89428318c4 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14
Jun 06 01:28:54 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:55 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf" returned: 0 in 0.768s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbff6a20-a684-4c6a-9bdb-34d73e823520(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:28:55 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-eb3be240-c095-45bc-9533-de06c06f4281" returned: 0 in 0.646s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:55 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d241f8-97a3-4b7c-b6d9-a58b90c42688]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:55 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-quobyte-eb3be240-c095-45bc-9533-de06c06f4281" released by "delete_volume" :: held 1.443s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:55 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] Created reservations ['d2620dfc-8b41-49fe-aa9e-1eeaf7e6680b', 'c3cef7fb-eed4-4339-8844-2c9c90542d6f', '5f345fc8-c70d-4f64-9ade-954239ce3bf6', 'd1a60635-e9d3-4733-81d6-5f40db9d2737'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:55 devstack sudo[107301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520
Jun 06 01:28:55 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:55 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:55 devstack sudo[107303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:28:55 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:55 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33c1537b-37b3-41e0-9623-0d89428318c4 -F qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14" returned: 0 in 0.689s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:55 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14 is being set with open permissions: ugo+rw
Jun 06 01:28:55 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:55 devstack sudo[107308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14
Jun 06 01:28:55 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:55 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "cinder-731cf63b-0c5c-4405-9691-04d908d20e2e-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:55 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-731cf63b-0c5c-4405-9691-04d908d20e2e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "cinder-quobyte-731cf63b-0c5c-4405-9691-04d908d20e2e" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-quobyte-731cf63b-0c5c-4405-9691-04d908d20e2e" acquired by "delete_volume" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:56 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:56 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2d721d-0232-4d0b-ad7f-687d5911faa7]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-731cf63b-0c5c-4405-9691-04d908d20e2e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:56 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.712s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:56 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:28:56 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] Deleted volume successfully.
Jun 06 01:28:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520" returned: 0 in 0.873s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:56 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-260ff7b0-543a-4acf-b56a-d08d571a7211 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-eb3be240-c095-45bc-9533-de06c06f4281-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:56 devstack sudo[107315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf
Jun 06 01:28:56 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:56 devstack sudo[107314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-731cf63b-0c5c-4405-9691-04d908d20e2e
Jun 06 01:28:56 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:56 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14" returned: 0 in 0.618s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:56 devstack sudo[107319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.info
Jun 06 01:28:56 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:56 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-731cf63b-0c5c-4405-9691-04d908d20e2e" returned: 0 in 0.743s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-731cf63b-0c5c-4405-9691-04d908d20e2e {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:56 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-731cf63b-0c5c-4405-9691-04d908d20e2e
Jun 06 01:28:56 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:56 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf" returned: 0 in 0.759s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:56 devstack sudo[107330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf
Jun 06 01:28:56 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:56 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.info" returned: 0 in 0.650s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:56 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.info is being set with open permissions: ugo+rw
Jun 06 01:28:56 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.info {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:56 devstack sudo[107332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.info
Jun 06 01:28:56 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:57 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-731cf63b-0c5c-4405-9691-04d908d20e2e" returned: 0 in 0.647s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:57 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520.1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf" returned: 0 in 0.633s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-quobyte-731cf63b-0c5c-4405-9691-04d908d20e2e" released by "delete_volume" :: held 1.455s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:57 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.info" returned: 0 in 0.602s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.193s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] Lock "cinder-quobyte-1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf" released by "_delete_snapshot" :: held 3.172s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] Lock "cinder-quobyte-dbff6a20-a684-4c6a-9bdb-34d73e823520" released by "delete_snapshot" :: held 3.202s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:57 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-75220402-78b0-4230-9f06-80d6f0c2993b tempest-SnapshotDependencyTests-845204522 None] Create snapshot completed successfully
Jun 06 01:28:57 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] Created reservations ['a60f010b-9955-4cd3-9734-f3fe624ba830', 'f01b34c0-69c8-49a9-9041-f78fc47cbfa3', '79811149-6d73-45c5-9290-a90fd4918252', '3f840dad-7fa6-4b18-bf94-ea643ed35df7'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:57 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] Created reservations ['9ffde99d-570c-40bb-8909-4fec66f4b431', 'cc4cc2ec-131b-460d-b079-909c04395434', '786cfc9b-ed32-4ae6-8937-532ba4c74547', '63ab2a00-b19a-44b8-ad70-47fa1194dfc1'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:57 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:57 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:57 devstack sudo[107337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:28:57 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:57 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] Delete snapshot completed successfully.
Jun 06 01:28:57 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-15af207e-667d-4b66-b113-3b97834c349e tempest-CinderUnicodeTest-1119506108 None] Lock "cinder-1d150c0b-ef56-4ace-aee5-07fe4ab9f7bf-delete_snapshot" released by "delete_snapshot" :: held 3.396s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "cinder-bcdb3977-26c2-4833-bc71-d57b7cea2d56-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-bcdb3977-26c2-4833-bc71-d57b7cea2d56-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "cinder-quobyte-bcdb3977-26c2-4833-bc71-d57b7cea2d56" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-quobyte-bcdb3977-26c2-4833-bc71-d57b7cea2d56" acquired by "delete_volume" :: waited 0.016s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:58 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d4fb77-1a3b-4f8c-9a84-95bbd277495c]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bcdb3977-26c2-4833-bc71-d57b7cea2d56 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:58 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.621s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:58 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:28:58 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] Deleted volume successfully.
Jun 06 01:28:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-82df1bfd-dd18-4d5e-9ad8-2c3a70b152c6 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-731cf63b-0c5c-4405-9691-04d908d20e2e-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:58 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bcdb3977-26c2-4833-bc71-d57b7cea2d56
Jun 06 01:28:58 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] Acquiring lock "cinder-dbff6a20-a684-4c6a-9bdb-34d73e823520-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] Lock "cinder-dbff6a20-a684-4c6a-9bdb-34d73e823520-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] Acquiring lock "cinder-quobyte-dbff6a20-a684-4c6a-9bdb-34d73e823520" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:58 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] Lock "cinder-quobyte-dbff6a20-a684-4c6a-9bdb-34d73e823520" acquired by "delete_volume" :: waited 0.028s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:58 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[962a7fb3-adf9-45ac-b856-f3f433dead1c]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:58 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:58 devstack sudo[107343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520
Jun 06 01:28:58 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:59 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bcdb3977-26c2-4833-bc71-d57b7cea2d56" returned: 0 in 0.800s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bcdb3977-26c2-4833-bc71-d57b7cea2d56 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:59 devstack sudo[107348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bcdb3977-26c2-4833-bc71-d57b7cea2d56
Jun 06 01:28:59 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86581) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Flow 'volume_create_manager' (a99d084d-f282-4763-aa7f-0639d73ddae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5884aaa-28b6-4f68-b39f-2b0e98ab85a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5884aaa-28b6-4f68-b39f-2b0e98ab85a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-05T23:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b6bc84da6f3471595e67953a90084c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-05T23:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=304e90b0-fb80-4917-8d6e-65f0174d6d14,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-05T23:28:59Z,use_quota=True,user_id='307ff226ded34157b3e310dea48e2849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9239ae6a-d0d5-490e-bfbf-26f354564c78),volume_type_id=9239ae6a-d0d5-490e-bfbf-26f354564c78)' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cb7f4e-7e19-44fe-8e31-c2d73c71e2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cb7f4e-7e19-44fe-8e31-c2d73c71e2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db9e8e6-68df-4165-94f3-b6bdebc2844b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db9e8e6-68df-4165-94f3-b6bdebc2844b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4', 'volume_name': 'volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4', 'volume_size': 1, 'snapshot_id': '304e90b0-fb80-4917-8d6e-65f0174d6d14'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8c70a7-3f4d-4967-a2b3-fe8874e3c417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8c70a7-3f4d-4967-a2b3-fe8874e3c417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c5ddc5-8bdb-4b8c-b71d-6b9941a16a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:28:59 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Volume cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4', 'volume_size': 1, 'snapshot_id': '304e90b0-fb80-4917-8d6e-65f0174d6d14'}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Acquiring lock "cinder-quobyte-304e90b0-fb80-4917-8d6e-65f0174d6d14-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4" by "_create_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_service.periodic_task [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-quobyte-304e90b0-fb80-4917-8d6e-65f0174d6d14-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Creating volume cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4 from snapshot 304e90b0-fb80-4917-8d6e-65f0174d6d14 {{(pid=86581) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Selected osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee as target Quobyte volume. {{(pid=86581) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Acquiring lock "cinder-quobyte-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4" by "_copy_volume_from_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:28:59 devstack sudo[107350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:28:59 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-quobyte-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] snapshot: 304e90b0-fb80-4917-8d6e-65f0174d6d14, volume: cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4,  {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[987b31aa-cda7-4b1e-8a24-0774099a41de]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:59 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520" returned: 0 in 0.795s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:28:59 devstack sudo[107355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14
Jun 06 01:28:59 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:59 devstack sudo[107356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520
Jun 06 01:28:59 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:28:59 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-bcdb3977-26c2-4833-bc71-d57b7cea2d56" returned: 0 in 0.689s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-quobyte-bcdb3977-26c2-4833-bc71-d57b7cea2d56" released by "delete_volume" :: held 1.553s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] Created reservations ['e4258b9f-51ca-4c9f-96ee-742559ee3dea', '795d27f6-300b-458d-88b1-1e68e9d7ea3f', '359bac67-cfbf-4cfc-96e9-1bdf226fb5db', 'e45b2f4d-f349-46e3-8608-4754c8040ee5'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:28:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:00 devstack sudo[107361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:29:00 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:00 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.736s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-0be26602-5370-4f77-9697-f49ff8822456 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:29:00 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14" returned: 0 in 0.785s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33c1537b-37b3-41e0-9623-0d89428318c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4 {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Creating direct copy from snapshot {{(pid=86581) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b1b23f-e1db-4e26-b112-5f331428bfcd]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:00 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-dbff6a20-a684-4c6a-9bdb-34d73e823520" returned: 0 in 0.748s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:00 devstack sudo[107368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] Lock "cinder-quobyte-dbff6a20-a684-4c6a-9bdb-34d73e823520" released by "delete_volume" :: held 1.613s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "cinder-9dedb5ce-e2d7-4588-afe2-8eea5ea570ac-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] Created reservations ['ec3411f9-2a9f-46e4-a209-54a4a1268ca0', 'dd9e73f6-cfec-40b4-8e2c-635867fc6480', 'b5bdc1bf-4166-4d60-abfc-1a23687d6b6d', '097d339c-359c-4080-8c65-b47d8a84ce9f'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-9dedb5ce-e2d7-4588-afe2-8eea5ea570ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "cinder-quobyte-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-quobyte-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "cinder-quobyte-9dedb5ce-e2d7-4588-afe2-8eea5ea570ac" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:29:00 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-quobyte-9dedb5ce-e2d7-4588-afe2-8eea5ea570ac" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] Deleting offline snapshot 9dedb5ce-e2d7-4588-afe2-8eea5ea570ac of volume 2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] snapshot_file for this snap is: volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca36710-bfd4-41aa-8de0-7e014b611ac9]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:00 devstack sudo[107374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:29:00 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:00 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.795s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:29:00 devstack sudo[107373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac
Jun 06 01:29:00 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:00 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] Deleted volume successfully.
Jun 06 01:29:00 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-77d74176-ade3-46f4-9063-8c8ecba2aeb2 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-bcdb3977-26c2-4833-bc71-d57b7cea2d56-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] Acquiring lock "cinder-b681590f-2eb2-40e3-a6ce-61a7e96fc608-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] Lock "cinder-b681590f-2eb2-40e3-a6ce-61a7e96fc608-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] Acquiring lock "cinder-quobyte-b681590f-2eb2-40e3-a6ce-61a7e96fc608" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] Lock "cinder-quobyte-b681590f-2eb2-40e3-a6ce-61a7e96fc608" acquired by "delete_volume" :: waited 0.018s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cb5ae9-16a0-48ff-9452-9ce249e0cc13]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b681590f-2eb2-40e3-a6ce-61a7e96fc608 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:01 devstack sudo[107377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b681590f-2eb2-40e3-a6ce-61a7e96fc608
Jun 06 01:29:01 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:01 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4" returned: 0 in 1.103s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG cinder.utils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Path /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4 not found in is_blk_device check {{(pid=86581) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:01 devstack sudo[107386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4
Jun 06 01:29:01 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:01 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.760s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:29:01 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:01 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] Deleted volume successfully.
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac" returned: 0 in 0.818s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27789cc-b6cf-430c-96c9-caa03a86f24c]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-bac298e3-9aaf-4775-a1f0-75ba2e0971ee tempest-CinderUnicodeTest-1119506108 None] Lock "cinder-dbff6a20-a684-4c6a-9bdb-34d73e823520-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:01 devstack sudo[107388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0
Jun 06 01:29:01 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:01 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b681590f-2eb2-40e3-a6ce-61a7e96fc608" returned: 0 in 0.777s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b681590f-2eb2-40e3-a6ce-61a7e96fc608 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:01 devstack sudo[107394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b681590f-2eb2-40e3-a6ce-61a7e96fc608
Jun 06 01:29:01 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:02 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0" returned: 0 in 0.927s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:02 devstack sudo[107408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac
Jun 06 01:29:02 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:03 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-b681590f-2eb2-40e3-a6ce-61a7e96fc608" returned: 0 in 1.102s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:03 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] Lock "cinder-quobyte-b681590f-2eb2-40e3-a6ce-61a7e96fc608" released by "delete_volume" :: held 1.966s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:03 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] Created reservations ['8975acfc-0435-42fd-8f5a-3b6daad0dca8', 'b4dceaf6-fba6-450f-aab9-aa32422fed73', 'b11d6175-7e66-4a72-8700-9f5eb8fa3d17', 'c3537f3e-91fd-4490-bf75-b0978aeaac01'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:29:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:29:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:29:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:29:03 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:29:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:29:03 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:03 devstack sudo[107413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:29:03 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:04 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac" returned: 0 in 2.123s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:04 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:04 devstack sudo[107418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac
Jun 06 01:29:04 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:05 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 1.892s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:05 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:29:05 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] Deleted volume successfully.
Jun 06 01:29:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-b3c956e4-8169-46c8-aef7-fac25fedefbd tempest-CinderUnicodeTest-1119506108 None] Lock "cinder-b681590f-2eb2-40e3-a6ce-61a7e96fc608-delete_volume" released by "delete_volume" :: held 4.363s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:05 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:05 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0.9dedb5ce-e2d7-4588-afe2-8eea5ea570ac" returned: 0 in 1.220s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-quobyte-9dedb5ce-e2d7-4588-afe2-8eea5ea570ac" released by "_delete_snapshot" :: held 5.293s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:05 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-quobyte-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0" released by "delete_snapshot" :: held 5.356s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:06 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] Created reservations ['0d7cdd33-2654-404b-83be-56e7fbf76d3c', 'b5872559-1ad4-4c00-99d9-90ba4a20393e', 'cb1a2d3c-8e2f-45b1-ba2f-ddb53c476caf', '8145b3f2-214b-4ff0-a782-200e87f037e2'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:29:06 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] Delete snapshot completed successfully.
Jun 06 01:29:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-76e5cc91-1a54-4e45-8fd8-650b2f08fa59 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-9dedb5ce-e2d7-4588-afe2-8eea5ea570ac-delete_snapshot" released by "delete_snapshot" :: held 5.602s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:06 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4" returned: 0 in 5.584s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:06 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "cinder-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:29:06 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a53aad-9281-44ca-8a9a-586889af1223]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:29:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:07 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:29:07 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "cinder-quobyte-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:29:07 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-quobyte-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0" acquired by "delete_volume" :: waited 0.015s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:29:07 devstack sudo[107423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4
Jun 06 01:29:07 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:07 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3ce997-f55b-44b7-a767-8b25b12b72f1]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:29:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:07 devstack sudo[107425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0
Jun 06 01:29:07 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:07 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0" returned: 0 in 0.700s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:07 devstack sudo[107433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0
Jun 06 01:29:07 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:07 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4" returned: 0 in 0.907s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:07 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Image conversion details: src /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4 {{(pid=86581) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jun 06 01:29:07 devstack cinder-volume[86581]: INFO cinder.image.image_utils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Converted 1024.00 MB image at 183.36 MB/s
Jun 06 01:29:07 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.remotefs [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4 is being set with open permissions: ugo+rw
Jun 06 01:29:07 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:07 devstack sudo[107435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4
Jun 06 01:29:07 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:08 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0" returned: 0 in 0.628s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:08 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-quobyte-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0" released by "delete_volume" :: held 1.414s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:08 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4" returned: 0 in 0.619s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:08 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-quobyte-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4" released by "_copy_volume_from_snapshot" :: held 9.119s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:08 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] Created reservations ['f5d00935-792c-4c63-ae17-a6fcaf06292e', '780a803e-1f28-40e2-9966-f7ca45146b6b', '42b9f780-c843-4c27-81d6-bd6d3bc43d5b', '6b8bed25-2c2a-4d7b-9a4f-144b637b795f'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:29:08 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-quobyte-304e90b0-fb80-4917-8d6e-65f0174d6d14-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4" released by "_create_volume_from_snapshot" :: held 9.152s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.190s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:29:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c5ddc5-8bdb-4b8c-b71d-6b9941a16a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4', 'volume_size': 1, 'snapshot_id': '304e90b0-fb80-4917-8d6e-65f0174d6d14'}' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:29:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018fe5e7-1617-45b2-87c5-ab850e76b08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 06 01:29:08 devstack cinder-volume[86581]: INFO cinder.volume.flows.manager.create_volume [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Volume volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4 (cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4): created successfully
Jun 06 01:29:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018fe5e7-1617-45b2-87c5-ab850e76b08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86581) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 06 01:29:08 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Flow 'volume_create_manager' (a99d084d-f282-4763-aa7f-0639d73ddae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86581) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 06 01:29:08 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-0ad813fb-57c8-4151-8d3e-66b636c5a51f tempest-SnapshotDependencyTests-845204522 None] Created volume successfully.
Jun 06 01:29:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:29:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:29:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:29:08 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:29:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:29:08 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:08 devstack sudo[107439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:29:08 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] Acquiring lock "cinder-304e90b0-fb80-4917-8d6e-65f0174d6d14-delete_snapshot" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:29:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-304e90b0-fb80-4917-8d6e-65f0174d6d14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:29:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] Acquiring lock "cinder-quobyte-33c1537b-37b3-41e0-9623-0d89428318c4" by "delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:29:09 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-quobyte-33c1537b-37b3-41e0-9623-0d89428318c4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:29:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] Acquiring lock "cinder-quobyte-304e90b0-fb80-4917-8d6e-65f0174d6d14" by "_delete_snapshot" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:29:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.622s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:09 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:29:09 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] Deleted volume successfully.
Jun 06 01:29:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-quobyte-304e90b0-fb80-4917-8d6e-65f0174d6d14" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:29:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] Deleting offline snapshot 304e90b0-fb80-4917-8d6e-65f0174d6d14 of volume 33c1537b-37b3-41e0-9623-0d89428318c4 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 06 01:29:09 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] snapshot_file for this snap is: volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14 {{(pid=86581) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 06 01:29:09 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9274109-080b-4afc-9d49-af8b8e9a9d46]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:29:09 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:09 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-97e05a94-5779-45bf-a76a-7bea7067ef88 tempest-CreateVolumesFromSnapshotTest-473469400 None] Lock "cinder-2bcf0f67-9e6b-448e-9fc9-fcd1302e84d0-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:09 devstack sudo[107442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14
Jun 06 01:29:09 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:10 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14" returned: 0 in 0.736s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:10 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33c1537b-37b3-41e0-9623-0d89428318c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86581) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 06 01:29:10 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d863b9-69d8-4e10-bd32-38cc34edfd2f]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:29:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:10 devstack sudo[107447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4
Jun 06 01:29:10 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:10 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4" returned: 0 in 0.741s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:10 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:10 devstack sudo[107452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14
Jun 06 01:29:10 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:11 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14" returned: 0 in 0.668s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:11 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:11 devstack sudo[107457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14
Jun 06 01:29:11 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:12 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4.304e90b0-fb80-4917-8d6e-65f0174d6d14" returned: 0 in 0.572s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-quobyte-304e90b0-fb80-4917-8d6e-65f0174d6d14" released by "_delete_snapshot" :: held 2.826s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-quobyte-33c1537b-37b3-41e0-9623-0d89428318c4" released by "delete_snapshot" :: held 2.860s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:12 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] Created reservations ['6ebf0c5a-2511-45c7-bd78-099f041395ce', '8bfd058f-18d1-49d7-89db-e364c2ce4d17', 'c99a080d-f21e-42a2-ada6-d17cfa257af1', '2be9e9a8-1437-4efa-94fc-8285b0980d6c'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:29:12 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] Delete snapshot completed successfully.
Jun 06 01:29:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-5eccfc1b-1f33-4957-b935-7074089f3676 tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-304e90b0-fb80-4917-8d6e-65f0174d6d14-delete_snapshot" released by "delete_snapshot" :: held 2.991s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] Acquiring lock "cinder-33c1537b-37b3-41e0-9623-0d89428318c4-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:29:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-33c1537b-37b3-41e0-9623-0d89428318c4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:29:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] Acquiring lock "cinder-quobyte-33c1537b-37b3-41e0-9623-0d89428318c4" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:29:12 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-quobyte-33c1537b-37b3-41e0-9623-0d89428318c4" acquired by "delete_volume" :: waited 0.013s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:29:12 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[e325e584-231a-4623-85a7-800d1cccd1d0]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:29:12 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:12 devstack sudo[107460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4
Jun 06 01:29:12 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:13 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4" returned: 0 in 0.676s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:13 devstack sudo[107465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4
Jun 06 01:29:13 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:13 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-33c1537b-37b3-41e0-9623-0d89428318c4" returned: 0 in 0.602s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:13 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-quobyte-33c1537b-37b3-41e0-9623-0d89428318c4" released by "delete_volume" :: held 1.332s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:13 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] Created reservations ['a7496fe0-3975-4529-94b0-165f408e7b94', 'db1fa5e4-de45-4da5-860f-7b499f881697', '52897edf-4a84-4082-9455-3615d044d50f', '5fe183b1-0d0a-46e6-8c88-d1bf65f8f372'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:29:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:29:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:29:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:29:13 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:29:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:29:13 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:13 devstack sudo[107469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:29:13 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:14 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.565s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:14 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:29:14 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] Deleted volume successfully.
Jun 06 01:29:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-a8f0509c-312b-4af4-b1b2-a7791cea2546 tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-33c1537b-37b3-41e0-9623-0d89428318c4-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] Acquiring lock "cinder-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4-delete_volume" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:29:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:29:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] Acquiring lock "cinder-quobyte-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4" by "delete_volume" {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 06 01:29:14 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-quobyte-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4" acquired by "delete_volume" :: waited 0.014s {{(pid=86581) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 06 01:29:14 devstack cinder-volume[86581]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd82c3d-6d71-4548-a9b2-ec9863f3a312]: (4, 'qcow2') {{(pid=87752) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 06 01:29:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:14 devstack sudo[107472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4
Jun 06 01:29:14 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:15 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4" returned: 0 in 0.673s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:15 devstack sudo[107477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4
Jun 06 01:29:15 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:15 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:15 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735/volume-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4" returned: 0 in 0.588s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:15 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-quobyte-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4" released by "delete_volume" :: held 1.298s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:15 devstack cinder-volume[86581]: DEBUG cinder.quota [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] Created reservations ['79277f17-49db-4811-b1c7-ebbce3821340', 'd0a261e9-50c1-4090-a65e-ca904fd131d9', '7aebba76-05cf-4e88-9fdc-ac81aff64e76', '4f178df8-6987-4132-ae12-c2eb657f1bed'] {{(pid=86581) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 06 01:29:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 06 01:29:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 06 01:29:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 06 01:29:16 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-592a9002-7025-4e29-a0f2-ae3320dd38ee'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 06 01:29:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 06 01:29:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735 {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 06 01:29:16 devstack sudo[107481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735
Jun 06 01:29:16 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 06 01:29:16 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root
Jun 06 01:29:16 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26f76dec36e3350f284349e8ae4ed735" returned: 0 in 0.580s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 06 01:29:16 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jun 06 01:29:16 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] Deleted volume successfully.
Jun 06 01:29:16 devstack cinder-volume[86581]: DEBUG cinder.coordination [None req-f9835c47-d365-455d-b28d-4ea784fc5ba1 tempest-SnapshotDependencyTests-845204522 None] Lock "cinder-cb3df6d3-fde5-4b57-9b3e-a8bd1b9981b4-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=86581) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 06 01:29:26 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=103,cinder:UPDATE=133,cinder:INSERT=34,cinder:DELETE=8 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 06 01:29:26 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:DELETE=14,cinder:SELECT=88,cinder:UPDATE=128,cinder:INSERT=39 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}